00010000:00010000:1.0F:1784044401.679937:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784044401.752802:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1784044401.752832:0:17179:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b38433c2600 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1784044401.752839:0:17179:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b39479dc100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b38433c2480 00000020:00080000:1.0:1784044401.752844:0:17179:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b39479dc600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b384450d000 00010000:00010000:3.0F:1784044401.752980:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044401.753006:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044401.753017:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044401.753025:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044401.753032:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044401.753042:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044401.753068:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:3.0:1784044401.753072:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044401.753078:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044401.753086:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0F:1784044401.754913:0:17240:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1784044401.755060:0:17240:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1784044402.701545:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044403.443536:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044403.443588:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044403.443618:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044403.443646:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565252352 00000100:00100000:1.0:1784044403.443655:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565252352 00000100:00100000:1.0:1784044403.443712:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565252480 00000100:00100000:1.0:1784044403.443715:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565252480 00000100:00100000:1.0:1784044403.443736:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:1.0:1784044403.443746:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+13:2409:x1870705565252352:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044403.443820:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+13:2409:x1870705565252352:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 75us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044403.443827:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:1.0:1784044403.443845:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:1.0:1784044403.443851:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565252480:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044403.443876:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565252480:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044403.443883:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:1.0:1784044403.443900:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565252224 00000100:00100000:1.0:1784044403.443903:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565252224 00000100:00100000:1.0:1784044403.443926:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:1.0:1784044403.443931:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+13:2409:x1870705565252224:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044403.443964:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+13:2409:x1870705565252224:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044403.443971:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00080000:1.0:1784044403.443999:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044403.444003:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044403.471345:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044403.471391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044403.471419:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565252608 00000100:00100000:2.0:1784044403.471430:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565252608 00000100:00100000:2.0:1784044403.471496:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565253120 00000100:00100000:2.0:1784044403.471499:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565253120 00000100:00100000:2.0:1784044403.471531:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:2.0:1784044403.471543:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2406:x1870705565252608:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:2.0:1784044403.471587:0:18707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba195d5 00000100:00080000:2.0:1784044403.471604:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9b3947bbf000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044403.471653:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1784044403.471848:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+2:2406:x1870705565252608:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 306us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044403.471858:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:2.0:1784044403.471876:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1784044403.471883:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2406:x1870705565253120:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:2.0:1784044403.471895:0:18707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19614 00000100:00080000:2.0:1784044403.471901:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9b38437dc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044403.471924:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1784044403.471979:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+2:2406:x1870705565253120:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 96us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044403.471986:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1784044403.472060:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044403.472128:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044403.472142:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565252736 00000100:00100000:2.0:1784044403.472146:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565252736 00000100:00100000:2.0:1784044403.472212:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1784044403.472219:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2410:x1870705565252736:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044403.472249:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2410:x1870705565252736:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 31us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044403.472255:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1784044403.472293:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044403.472384:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044403.472396:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565253248 00000100:00100000:2.0:1784044403.472399:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565253248 00000100:00100000:2.0:1784044403.472415:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:2.0:1784044403.472420:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2406:x1870705565253248:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:2.0:1784044403.472431:0:18707:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1961b 00000100:00080000:2.0:1784044403.472439:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9b3974972800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044403.472460:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1784044403.472533:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+2:2406:x1870705565253248:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 111us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044403.472539:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00010000:00010000:0.0F:1784044403.475784:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044403.475833:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565252864 00000100:00100000:0.0:1784044403.475843:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565252864 00000100:00100000:0.0:1784044403.475916:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565252992 00000100:00100000:0.0:1784044403.475918:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565252992 00000100:00100000:0.0:1784044403.475954:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:0.0:1784044403.475964:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2410:x1870705565252864:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044403.476065:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2410:x1870705565252864:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 103us (4004us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044403.476073:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:0.0:1784044403.476103:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:0.0:1784044403.476109:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2410:x1870705565252992:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044403.476131:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2410:x1870705565252992:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (3837us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044403.476136:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 91 00010000:00010000:3.0:1784044403.479246:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044403.479261:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044403.479266:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044403.479270:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044403.479273:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784044403.479696:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044403.728300:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044403.791348:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044403.791375:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581077120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044403.791450:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044403.791622:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581077120 00000100:00100000:2.0:1784044403.791632:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581077120 00000100:00100000:2.0:1784044403.791707:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044403.791718:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581077120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044403.791763:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044403.791813:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581077120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044403.791819:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1784044403.791877:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044403.791917:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581077120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784044404.749426:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044404.814706:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581077248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044404.814833:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044404.814976:0:20400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581077248 00000100:00100000:1.0:1784044404.814986:0:20400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581077248 00000100:00100000:1.0:1784044404.815052:0:20400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784044404.815062:0:20400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581077248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044404.815085:0:20400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044404.815133:0:20400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581077248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044404.815140:0:20400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784044404.815214:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581077248:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784044404.815295:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044404.860057:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044404.860262:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565253376 00000100:00100000:1.0:1784044404.860273:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565253376 00000100:00100000:1.0:1784044404.860353:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1784044404.860364:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+13:15611:x1870705565253376:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1784044404.860475:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+13:15611:x1870705565253376:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 112us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044404.860482:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1784044404.888337:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044404.888442:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565253504 00000100:00100000:3.0:1784044404.888468:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565253504 00000100:00100000:3.0:1784044404.888648:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:3.0:1784044404.888692:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:15611:x1870705565253504:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1784044404.888911:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:15611:x1870705565253504:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 210us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044404.888920:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:3.0:1784044404.899356:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044404.899626:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565253760 00000100:00100000:1.0:1784044404.899637:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565253760 00000100:00100000:1.0:1784044404.899699:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:1.0:1784044404.899724:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+13:15611:x1870705565253760:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784044404.900010:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+14:15611:x1870705565253760:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 288us (662us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1784044404.900018:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000040:00080000:3.0:1784044405.394289:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784044405.394300:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044405.394319:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784044405.394331:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1784044405.774425:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044405.838727:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581077376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044405.838820:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044405.838923:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581077504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044405.838954:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044405.839209:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581077504 00000100:00100000:3.0:1784044405.839219:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581077504 00000100:00100000:3.0:1784044405.839268:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784044405.839278:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581077504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044405.839721:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1784044405.839778:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581077504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 501us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044405.839785:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1784044405.841074:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044405.841128:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581077504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044405.841150:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044405.841159:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581077632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044405.841253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044405.841282:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581077632 00000100:00100000:3.0:1784044405.841289:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581077632 00000100:00100000:3.0:1784044405.841496:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784044405.841507:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581077632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044405.841528:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1784044405.841582:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581077632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044405.841589:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1784044405.842023:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044405.842057:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581077632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044405.842386:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581077376 00000100:00100000:2.0:1784044405.842399:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581077376 00000100:00100000:2.0:1784044405.842436:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784044405.842444:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581077376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044405.842475:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1784044405.842530:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581077376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (3708us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044405.842538:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784044405.842574:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581078144:0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.842605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044405.842637:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581078656:0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.842661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044405.842684:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784044405.842684:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581078144 00000100:00100000:1.0:1784044405.842690:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581078144 00000100:00100000:2.0:1784044405.842694:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581078016:0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.842721:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044405.842749:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581078528:0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.842771:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044405.842790:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581079040:0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.842811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044405.842841:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581078656 00000100:00100000:2.0:1784044405.842845:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581078656 00000100:00100000:2.0:1784044405.842874:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581078528 00000100:00100000:2.0:1784044405.842878:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581078528 00000100:00100000:2.0:1784044405.842895:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581079040 00000100:00100000:2.0:1784044405.842898:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581079040 00000100:00100000:1.0:1784044405.842914:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784044405.842922:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784044405.842928:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581078144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.842935:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581078656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044405.842981:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581078144:12345-0@lo:400:kworker.0 Request processed in 59us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044405.842989:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581078656:12345-0@lo:400:kworker.0 Request processed in 55us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044405.842990:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784044405.843005:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784044405.843024:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784044405.843034:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784044405.843035:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581078528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044405.843047:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581079040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.843076:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581078528:12345-0@lo:400:kworker.0 Request processed in 44us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044405.843084:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784044405.843090:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581079040:12345-0@lo:400:kworker.0 Request processed in 46us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044405.843098:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784044405.843104:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581078016 00000100:00100000:2.0:1784044405.843109:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581078016 00000100:00100000:2.0:1784044405.843132:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784044405.843139:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581078016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.843171:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581078016:12345-0@lo:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044405.843204:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784044405.843210:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581077888:0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.843238:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581078016:0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.843252:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581078528:0@lo:400:kworker.0 00010000:00080000:2.0:1784044405.843267:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3945931180 x1870705581079040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044405.843268:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044405.843281:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581079040:0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.843295:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581078144:0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.843309:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581078656:0@lo:400:kworker.0 00000100:00100000:0.0:1784044405.843548:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581078400:0@lo:400:kworker.0 00000100:00100000:0.0:1784044405.843588:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044405.843689:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705581078912:0@lo:400:kworker.0 00000100:00100000:0.0:1784044405.843955:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044405.844227:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581077888 00000100:00100000:1.0:1784044405.844234:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581077888 00000100:00100000:1.0:1784044405.844272:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784044405.844279:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3641:x1870705581077888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044405.844495:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581077376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044405.844521:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784044405.844530:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581077760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044405.844571:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044405.844592:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581078272:0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.844946:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581078400 00000100:00100000:2.0:1784044405.844951:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581078400 00000100:00100000:2.0:1784044405.844984:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784044405.845004:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581078400:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784044405.845111:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044405.845118:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044405.845121:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044405.845136:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581078912 00000100:00100000:3.0:1784044405.845141:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581078912 00000100:00100000:3.0:1784044405.845198:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784044405.845205:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705581078912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044405.849807:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581078400:12345-0@lo:400:kworker.0 Request processed in 4787us (6201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044405.849827:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1784044405.849916:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044405.849963:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581077760 00000100:00100000:2.0:1784044405.849971:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581077760 00000100:00100000:2.0:1784044405.850017:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784044405.850025:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581077760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784044405.850065:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784044405.850149:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581077760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (5576us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044405.850155:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784044405.852211:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705581078912:12345-0@lo:400:kworker.0 Request processed in 6998us (8248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044405.852225:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784044405.852628:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044405.852684:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581078784:0@lo:400:kworker.0 00000100:00100000:0.0:1784044405.852735:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044405.852785:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581078400:0@lo:400:kworker.0 00000100:00100000:0.0:1784044405.852808:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705581078912:0@lo:400:kworker.0 00000100:00100000:0.0:1784044405.852842:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581077760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044405.852956:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581078272 00000100:00100000:3.0:1784044405.852962:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581078272 00000100:00100000:3.0:1784044405.853014:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581078784 00000100:00100000:3.0:1784044405.853017:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581078784 00000100:00100000:3.0:1784044405.853047:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784044405.853066:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581078272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044405.853125:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581078272:12345-0@lo:400:kworker.0 Request processed in 60us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044405.853132:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784044405.853157:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784044405.853164:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581078784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044405.853220:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581078784:12345-0@lo:400:kworker.0 Request processed in 56us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044405.853227:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1784044405.854433:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044405.854617:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581078272:0@lo:400:kworker.0 00010000:00080000:0.0:1784044405.854636:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d83100 x1870705581078784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044405.854647:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581078784:0@lo:400:kworker.0 00000100:00100000:1.0:1784044405.854888:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3641:x1870705581077888:12345-0@lo:400:kworker.0 Request processed in 10608us (11621us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044405.854899:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1784044405.854978:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581077888:0@lo:400:kworker.0 00000100:00100000:0.0:1784044406.506024:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044406.506076:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044406.506106:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044406.506151:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044406.506214:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044406.506239:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044406.506353:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565253888 00000100:00100000:1.0:1784044406.506362:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565253888 00000100:00100000:1.0:1784044406.506422:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:1.0:1784044406.506447:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+13:2409:x1870705565253888:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044406.506528:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+13:2409:x1870705565253888:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044406.506536:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:1.0:1784044406.506585:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565254272 00000100:00100000:1.0:1784044406.506589:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565254272 00000100:00100000:1.0:1784044406.506635:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:1.0:1784044406.506641:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565254272:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044406.506672:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565254272:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 31us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044406.506678:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:3.0:1784044406.507344:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565254016 00000100:00100000:3.0:1784044406.507352:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565254016 00000100:00100000:3.0:1784044406.507388:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565254528 00000100:00100000:3.0:1784044406.507391:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565254528 00000100:00100000:3.0:1784044406.507406:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565254144 00000100:00100000:3.0:1784044406.507418:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565254144 00000100:00100000:3.0:1784044406.507435:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565254400 00000100:00100000:3.0:1784044406.507438:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565254400 00000100:00100000:3.0:1784044406.507452:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:3.0:1784044406.507460:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+14:2409:x1870705565254016:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044406.507518:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+14:2409:x1870705565254016:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 59us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044406.507525:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:3.0:1784044406.507540:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:3.0:1784044406.507557:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2409:x1870705565254528:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044406.507584:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2409:x1870705565254528:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 39us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044406.507589:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:3.0:1784044406.507600:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:3.0:1784044406.507606:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565254144:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044406.507628:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565254144:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044406.507634:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:3.0:1784044406.507646:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:3.0:1784044406.507652:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2409:x1870705565254400:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044406.507675:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2409:x1870705565254400:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044406.507681:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00080000:2.0:1784044406.508624:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044406.508632:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044406.508635:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784044406.797828:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044407.821484:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784044407.893777:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1784044407.893796:0:17179:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1784044407.893926:0:17240:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1784044407.893936:0:17240:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:1.0:1784044408.568755:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044408.568800:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044408.568829:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565254656 00000100:00100000:0.0:1784044408.568842:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565254656 00000100:00100000:1.0:1784044408.568885:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044408.568977:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:0.0:1784044408.568990:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:2407:x1870705565254656:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044408.569117:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:2407:x1870705565254656:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 129us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044408.569126:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:1.0:1784044408.572164:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044408.572213:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565254912 00000100:00100000:3.0:1784044408.572223:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565254912 00000100:00100000:2.0:1784044408.572254:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565255168 00000100:00100000:2.0:1784044408.572261:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565255168 00000100:00100000:3.0:1784044408.572316:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 102 00000100:00080000:0.0:1784044408.572320:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044408.572326:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044408.572332:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565254912:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044408.572390:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:2.0:1784044408.572401:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2407:x1870705565255168:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044408.572424:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565254912:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 98us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044408.572433:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 102 00000100:00100000:2.0:1784044408.572450:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2407:x1870705565255168:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 50us (3564us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044408.572459:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:1.0:1784044408.574600:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044408.574693:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044408.574846:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565254784 00000100:00100000:0.0:1784044408.574855:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565254784 00000100:00100000:3.0:1784044408.574901:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565255040 00000100:00100000:3.0:1784044408.574906:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565255040 00000100:00100000:0.0:1784044408.574939:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565255296 00000100:00100000:0.0:1784044408.574945:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565255296 00000100:00100000:0.0:1784044408.574971:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:0.0:1784044408.574980:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+13:2407:x1870705565254784:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044408.575065:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+13:2407:x1870705565254784:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 84us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044408.575073:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1784044408.575078:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:3.0:1784044408.575085:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565255040:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044408.575101:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:0.0:1784044408.575111:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565255296:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044408.575123:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565255040:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 39us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044408.575131:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1784044408.575144:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565255296:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044408.575152:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00080000:1.0:1784044408.575260:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044408.575266:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044408.575269:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784044408.845466:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044408.911207:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044408.911239:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581079168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044408.911342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044408.913198:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581079168 00000100:00100000:0.0:1784044408.913218:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581079168 00000100:00100000:0.0:1784044408.913340:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784044408.913351:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581079168:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784044408.913360:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1784044408.913389:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784044408.913479:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581079168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044408.913488:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784044408.913608:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581079168:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1784044408.925041:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35f5085c-0464-4087-9b4b-890cdd0735b4 00000020:00000080:3.0:1784044408.925054:0:19522:0:(genops.c:906:class_export_put()) final put ffff9b3974970000/35f5085c-0464-4087-9b4b-890cdd0735b4 00000020:00000080:1.0:1784044408.925205:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974970000/35f5085c-0464-4087-9b4b-890cdd0735b4 for lustre-OST0001 00000020:00000080:1.0:1784044408.925283:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3974972800 for lustre-OST0001 00000001:00100000:0.0:1784044408.925811:0:18702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35f5085c-0464-4087-9b4b-890cdd0735b4 00000020:00000080:0.0:1784044408.925815:0:18702:0:(genops.c:906:class_export_put()) final put ffff9b39749d8000/35f5085c-0464-4087-9b4b-890cdd0735b4 00000001:00100000:0.0:1784044408.925836:0:18702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000020:00000080:0.0:1784044408.925838:0:18702:0:(genops.c:906:class_export_put()) final put ffff9b3947bbd000/ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000020:00000080:1.0:1784044408.925890:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39749d8000/35f5085c-0464-4087-9b4b-890cdd0735b4 for lustre-OST0000 00000020:00000080:1.0:1784044408.925921:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3947bbd000/ffd836bb-8324-4bbb-bdb8-ace806f205ee for lustre-OST0000 00000020:00000080:1.0:1784044408.925968:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b38437dc000 for lustre-OST0000 00000020:00000080:1.0:1784044408.925972:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3947bbf000 for lustre-OST0000 00010000:00010000:1.0:1784044409.872357:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044409.933340:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044409.933363:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581079296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044409.933444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044409.933507:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581079296 00000100:00100000:1.0:1784044409.933526:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581079296 00000100:00100000:1.0:1784044409.933598:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784044409.933606:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581079296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044409.933627:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044409.933666:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581079296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044409.933673:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1784044409.933763:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044409.933797:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581079296:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1784044410.095576:0:20580:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 11:53:27 (1784044407) 00000040:00080000:2.0:1784044410.832845:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784044410.899738:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044410.957466:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044410.957522:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581079424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044410.957623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044410.957697:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581079552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044410.957736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044410.957774:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581079424 00000100:00100000:0.0:1784044410.957781:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581079424 00000100:00100000:0.0:1784044410.957841:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784044410.957851:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581079424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044410.957888:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784044410.957948:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581079424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044410.957956:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784044410.957981:0:20400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581079552 00000100:00100000:0.0:1784044410.957984:0:20400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581079552 00000100:00100000:0.0:1784044410.958015:0:20400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784044410.958022:0:20400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581079552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044410.958043:0:20400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1784044410.958079:0:20400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581079552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044410.958086:0:20400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784044410.958135:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581079552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044410.958166:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581079424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044410.958352:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044410.958364:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581079808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044410.958397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044410.958434:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044410.958538:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581079808 00000100:00100000:3.0:1784044410.958544:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581079808 00000100:00100000:3.0:1784044410.958591:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784044410.958599:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581079808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044410.958621:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1784044410.958673:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581079808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044410.958681:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784044410.958762:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581079808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044410.959384:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581079936:0@lo:400:kworker.0 00000100:00100000:1.0:1784044410.959426:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044410.959497:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581079936 00000100:00100000:3.0:1784044410.959503:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581079936 00000100:00100000:3.0:1784044410.959549:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784044410.959557:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3641:x1870705581079936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044410.961812:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3641:x1870705581079936:12345-0@lo:400:kworker.0 Request processed in 2246us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044410.961828:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784044410.966614:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581079680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044410.966695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044410.966734:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581080192:0@lo:400:kworker.0 00000100:00100000:0.0:1784044410.966782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044410.966810:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581080704:0@lo:400:kworker.0 00000100:00100000:0.0:1784044410.966863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044410.966893:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784044410.966903:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581080064:0@lo:400:kworker.0 00000100:00100000:0.0:1784044410.966929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044410.966966:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581080576:0@lo:400:kworker.0 00000100:00100000:0.0:1784044410.967062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044410.967082:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581081088:0@lo:400:kworker.0 00000100:00100000:0.0:1784044410.967104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044410.967139:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581079680 00000100:00100000:0.0:1784044410.967147:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581079680 00000100:00100000:0.0:1784044410.967231:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784044410.967241:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397493b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581079680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044410.967268:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1784044410.967319:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397493b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581079680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044410.967327:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784044410.967352:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581080192 00000100:00100000:0.0:1784044410.967356:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581080192 00000100:00100000:0.0:1784044410.967381:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581080064 00000100:00100000:0.0:1784044410.967384:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581080064 00000100:00100000:0.0:1784044410.967407:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784044410.967414:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581080192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044410.967447:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581080192:12345-0@lo:400:kworker.0 Request processed in 33us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044410.967464:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784044410.967478:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784044410.967484:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581080064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044410.971898:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581080704 00000100:00100000:2.0:1784044410.971917:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581080704 00000100:00100000:2.0:1784044410.971993:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581080576 00000100:00100000:2.0:1784044410.971997:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581080576 00000100:00100000:2.0:1784044410.972020:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581081088 00000100:00100000:2.0:1784044410.972023:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581081088 00000100:00100000:2.0:1784044410.972044:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784044410.972053:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397493a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581080704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044410.972224:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581079936:0@lo:400:kworker.0 00000100:00100000:1.0:1784044410.972279:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581080448:0@lo:400:kworker.0 00000100:00100000:1.0:1784044410.972355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044410.972392:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705581080960:0@lo:400:kworker.0 00000100:00100000:1.0:1784044410.972421:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044410.972441:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784044410.972449:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581080320:0@lo:400:kworker.0 00000100:00100000:1.0:1784044410.972473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044410.972485:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3974bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581080832:0@lo:400:kworker.0 00000100:00100000:1.0:1784044410.972515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044410.972619:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581079680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044410.972629:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581080192:0@lo:400:kworker.0 00000100:00100000:0.0:1784044410.972846:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581080064:12345-0@lo:400:kworker.0 Request processed in 5360us (5915us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044410.972855:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784044410.972877:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581080448 00000100:00100000:0.0:1784044410.972882:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581080448 00000100:00100000:0.0:1784044410.972903:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784044410.972909:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581080448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044410.972946:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581080448:12345-0@lo:400:kworker.0 Request processed in 36us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044410.972952:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044410.973057:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581080064:0@lo:400:kworker.0 00000100:00100000:1.0:1784044410.973084:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581080448:0@lo:400:kworker.0 00000100:00100000:2.0:1784044410.973238:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397493a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581080704:12345-0@lo:400:kworker.0 Request processed in 1184us (6373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044410.973247:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784044410.973262:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581080960 00000100:00100000:2.0:1784044410.973265:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581080960 00000100:00100000:2.0:1784044410.973283:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581080320 00000100:00100000:2.0:1784044410.973286:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581080320 00000100:00100000:2.0:1784044410.973295:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581080832 00000100:00100000:2.0:1784044410.973297:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581080832 00000100:00100000:2.0:1784044410.973309:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784044410.973315:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581080576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044410.973346:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397493aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581080576:12345-0@lo:400:kworker.0 Request processed in 30us (6284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044410.973353:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784044410.973365:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784044410.973371:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581081088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044410.973401:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581081088:12345-0@lo:400:kworker.0 Request processed in 30us (6295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044410.973407:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784044410.973429:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784044410.973435:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705581080960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044410.973466:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705581080960:12345-0@lo:400:kworker.0 Request processed in 32us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044410.973471:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784044410.973482:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784044410.973487:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581080320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044410.973524:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581080320:12345-0@lo:400:kworker.0 Request processed in 36us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044410.973531:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784044410.973542:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784044410.973548:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581080832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044410.973574:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581080832:12345-0@lo:400:kworker.0 Request processed in 26us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044410.973580:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1784044410.973619:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044410.973622:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044410.973625:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784044410.973627:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044410.973767:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581080320:0@lo:400:kworker.0 00010000:00080000:0.0:1784044410.973782:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3974bfc000 x1870705581080832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044410.973791:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581080832:0@lo:400:kworker.0 00000100:00100000:0.0:1784044410.973801:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705581080960:0@lo:400:kworker.0 00000100:00100000:1.0:1784044410.974963:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581080704:0@lo:400:kworker.0 00000100:00100000:1.0:1784044410.975118:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581080576:0@lo:400:kworker.0 00010000:00080000:1.0:1784044410.975131:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3974939500 x1870705581081088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044410.975141:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3974939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581081088:0@lo:400:kworker.0 00010000:00010000:3.0:1784044411.922667:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044412.941831:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044413.670585:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044413.670636:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044413.670676:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044413.670736:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044413.670770:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565255808 00000100:00100000:3.0:1784044413.671160:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565255552 00000100:00100000:3.0:1784044413.671206:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565255552 00000100:00100000:3.0:1784044413.671272:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565255680 00000100:00100000:3.0:1784044413.671288:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565255680 00000100:00100000:3.0:1784044413.671315:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:3.0:1784044413.671326:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397493b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+13:2409:x1870705565255552:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044413.671405:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397493b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+13:2409:x1870705565255552:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 82us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044413.671413:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:3.0:1784044413.671430:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:3.0:1784044413.671436:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565255680:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044413.671458:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397493a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565255680:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044413.671463:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:1.0:1784044413.671719:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565255424 00000100:00100000:1.0:1784044413.671724:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565255424 00000100:00100000:1.0:1784044413.671760:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00100000:1.0:1784044413.671767:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:2409:x1870705565255424:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044413.671810:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:2409:x1870705565255424:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044413.671831:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00080000:2.0:1784044413.672511:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044413.672520:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044413.672603:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565255808 00000100:00100000:0.0:1784044413.672676:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:0.0:1784044413.672683:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397493bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565255808:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044413.672729:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397493bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565255808:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 47us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044413.672736:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00080000:2.0:1784044413.672936:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044413.673679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044413.673885:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565255936 00000100:00100000:2.0:1784044413.673893:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565255936 00000100:00100000:2.0:1784044413.673964:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:2.0:1784044413.673973:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2410:x1870705565255936:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:1.0:1784044413.674106:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044413.675025:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2410:x1870705565255936:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1045us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044413.675049:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:0.0:1784044413.675232:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044413.675297:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565256064 00000100:00100000:2.0:1784044413.675304:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565256064 00000100:00100000:2.0:1784044413.675391:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:2.0:1784044413.675399:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2409:x1870705565256064:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044413.675450:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2409:x1870705565256064:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 52us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044413.675455:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00080000:1.0:1784044413.675626:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784044413.965466:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044414.031061:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044414.031098:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581081216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044414.031215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044414.033119:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581081216 00000100:00100000:1.0:1784044414.033147:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581081216 00000100:00100000:1.0:1784044414.033270:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784044414.033292:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581081216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044414.033328:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044414.033408:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581081216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044414.033416:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1784044414.033509:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044414.034418:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581081216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044414.485124:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044414.485268:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565256320 00000100:00100000:0.0:1784044414.485279:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565256320 00000100:00100000:0.0:1784044414.485344:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1784044414.485356:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+13:16374:x1870705565256320:12345-192.168.202.40@tcp:35:umount.0 00000001:00080000:0.0:1784044414.485894:0:17203:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:0.0:1784044414.486639:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+15:16374:x1870705565256320:12345-192.168.202.40@tcp:35:umount.0 Request processed in 1281us (1521us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1784044414.486650:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000020:00080000:0.0:1784044414.486656:0:17203:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784044414.492223:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044414.492270:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044414.492303:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044414.492358:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044414.492384:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565256448 00000100:00100000:2.0:1784044414.492396:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565256448 00000100:00100000:2.0:1784044414.492481:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565256704 00000100:00100000:2.0:1784044414.492485:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565256704 00000100:00100000:2.0:1784044414.492501:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565256832 00000100:00100000:2.0:1784044414.492503:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565256832 00000100:00100000:2.0:1784044414.492523:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:2.0:1784044414.492532:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf001828-7720-4c65-ba45-a14bcd113197+15:2410:x1870705565256448:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044414.492551:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784044414.492565:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565256576 00000100:00100000:3.0:1784044414.492571:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565256576 00010000:00010000:2.0:1784044414.492575:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7c00/0x89871fc3aba195b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a2f expref: 15 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044414.492595:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044414.492613:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:3.0:1784044414.492622:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2406:x1870705565256576:12345-192.168.202.40@tcp:9:umount.0 00000100:00100000:2.0:1784044414.492651:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf001828-7720-4c65-ba45-a14bcd113197+14:2410:x1870705565256448:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 118us (437us total) trans 0 rc 0/0 00000020:00000080:3.0:1784044414.492657:0:18933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba195dc 00000100:00080000:3.0:1784044414.492669:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9b3947bbf800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784044414.492776:0:18933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1784044414.492936:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+2:2406:x1870705565256576:12345-192.168.202.40@tcp:9:umount.0 Request processed in 314us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044414.492943:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:1.0:1784044414.493322:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1784044414.493334:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf001828-7720-4c65-ba45-a14bcd113197+14:2409:x1870705565256704:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044414.493346:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044414.493358:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39586efa00/0x89871fc3aba195b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a60 expref: 14 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044414.493370:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044414.493390:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf001828-7720-4c65-ba45-a14bcd113197+13:2409:x1870705565256704:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 61us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044414.493397:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1784044414.493416:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:1.0:1784044414.493422:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf001828-7720-4c65-ba45-a14bcd113197+12:2409:x1870705565256832:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044414.493430:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044414.493449:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b397cb19800/0x89871fc3aba19676 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b16 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044414.499231:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044414.499305:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf001828-7720-4c65-ba45-a14bcd113197+11:2409:x1870705565256832:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 5876us (6941us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044414.499319:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00010000:00010000:1.0:1784044414.499568:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044414.500974:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1784044414.510899:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044414.511005:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565257728 00000100:00100000:2.0:1784044414.511015:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565257728 00000100:00100000:2.0:1784044414.511091:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:2.0:1784044414.511101:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+15:2406:x1870705565257728:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:2.0:1784044414.511134:0:17201:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba195c7 00000020:00010000:2.0:1784044414.511149:0:17201:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b39741fc800: total 0 00000100:00080000:2.0:1784044414.511154:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9b39741fd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044414.511213:0:17201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:2.0:1784044414.511374:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+14:2406:x1870705565257728:12345-192.168.202.40@tcp:39:umount.0 Request processed in 273us (486us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1784044414.511382:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000020:00010000:0.0:1784044414.511497:0:17188:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b39741fc800: total 0 00010000:00010000:0.0:1784044414.511552:0:17188:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b39741fc800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1784044414.511629:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:0.0:1784044414.511633:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044414.511642:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba198de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bd3 expref: 13 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044414.511684:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b397b61a700) 00010000:00010000:0.0:1784044414.511686:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044414.511691:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee600/0x89871fc3aba196ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b24 expref: 12 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044414.511709:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3975b83400) 00010000:00010000:0.0:1784044414.511711:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044414.511715:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba196ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b32 expref: 11 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044414.511727:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:0.0:1784044414.511729:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044414.511732:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba1987c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb0 expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044414.511747:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b397b61af00) 00010000:00010000:0.0:1784044414.511749:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044414.511753:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee000/0x89871fc3aba19692 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b1d expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044414.511767:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:0.0:1784044414.511769:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784044414.511773:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19200/0x89871fc3aba19772 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b5c expref: 8 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044414.511786:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:0.0:1784044414.511795:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784044414.511800:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19821 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b9b expref: 7 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044414.511813:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:0.0:1784044414.511815:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784044414.511817:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b86 expref: 6 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044414.511829:0:17188:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b39741fc800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1784044414.511841:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044414.511843:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044414.511845:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044414.517792:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044414.517929:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565257856 00000100:00100000:2.0:1784044414.517938:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565257856 00000100:00100000:2.0:1784044414.518003:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:2.0:1784044414.518015:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2406:x1870705565257856:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:2.0:1784044414.518060:0:17199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba195ce 00000100:00080000:2.0:1784044414.518079:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9b39749de800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044414.518111:0:17199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1784044414.518374:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+3:2406:x1870705565257856:12345-192.168.202.40@tcp:39:umount.0 Request processed in 359us (593us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784044414.518382:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00010000:00010000:1.0:1784044414.518640:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044414.990596:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044415.053888:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044415.053955:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581081344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044415.054032:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044415.054344:0:20400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581081344 00000100:00100000:1.0:1784044415.054353:0:20400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581081344 00000100:00100000:1.0:1784044415.054431:0:20400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044415.054440:0:20400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581081344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044415.054480:0:20400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1784044415.054505:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044415.054540:0:20400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581081344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044415.054547:0:20400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784044415.054781:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581081344:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1784044415.629716:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784044415.629725:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784044415.629744:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1784044415.629766:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1784044416.013446:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044416.077653:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784044416.077683:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581081472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044416.077794:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044416.077870:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581081472 00000100:00100000:2.0:1784044416.077872:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581081600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044416.077878:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581081472 00000100:00100000:2.0:1784044416.077899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044416.077931:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784044416.077940:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581081472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044416.077986:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1784044416.078053:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581081472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044416.078061:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784044416.078166:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581081472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044416.078224:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397493b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581081728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044416.078234:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581081856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044416.078252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044416.078254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044416.078285:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581081728 00000100:00100000:0.0:1784044416.078290:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581081728 00000100:00100000:0.0:1784044416.078309:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784044416.078314:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581081728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044416.078330:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784044416.078408:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581081728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044416.078415:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784044416.078447:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044416.078456:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581082112:0@lo:400:kworker.0 00000100:00100000:0.0:1784044416.078498:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044416.078518:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581081984:0@lo:400:kworker.0 00000100:00100000:3.0:1784044416.078525:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581082112 00000100:00100000:3.0:1784044416.078528:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581082112 00000100:00100000:3.0:1784044416.078566:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784044416.078573:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581082112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044416.078629:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581082368:0@lo:400:kworker.0 00000100:00100000:1.0:1784044416.078641:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581081600 00000100:00100000:1.0:1784044416.078645:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581081600 00000100:00100000:1.0:1784044416.078677:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581081856 00000100:00100000:1.0:1784044416.078680:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581081856 00000100:00100000:1.0:1784044416.078693:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784044416.078699:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581081600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044416.078724:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1784044416.081821:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397493ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581082112:12345-0@lo:400:kworker.0 Request processed in 3235us (3308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044416.081860:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784044416.081959:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581082240:0@lo:400:kworker.0 00000100:00100000:3.0:1784044416.082015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044416.082051:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581082752:0@lo:400:kworker.0 00000100:00100000:3.0:1784044416.082076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044416.082148:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397493b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581081728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044416.084534:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581082240 00000100:00100000:3.0:1784044416.084551:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581082240 00000100:00100000:3.0:1784044416.084612:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581082752 00000100:00100000:3.0:1784044416.084615:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581082752 00000100:00100000:3.0:1784044416.084646:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784044416.084655:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581082240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044416.084749:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581082240:12345-0@lo:400:kworker.0 Request processed in 95us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044416.084757:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784044416.084771:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784044416.084777:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581082752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044416.084816:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581082752:12345-0@lo:400:kworker.0 Request processed in 39us (2740us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044416.084822:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784044416.084867:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581082240:0@lo:400:kworker.0 00010000:00080000:3.0:1784044416.084885:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39503bca80 x1870705581082752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044416.084897:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581082752:0@lo:400:kworker.0 00000100:00100000:3.0:1784044416.084944:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581082496:0@lo:400:kworker.0 00000100:00100000:3.0:1784044416.084978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044416.085010:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581083008:0@lo:400:kworker.0 00000100:00100000:3.0:1784044416.085027:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044416.085043:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044416.085049:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581082624:0@lo:400:kworker.0 00000100:00100000:3.0:1784044416.085067:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044416.085086:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581082496 00000100:00100000:3.0:1784044416.085089:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581082496 00000100:00100000:3.0:1784044416.085105:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581083008 00000100:00100000:3.0:1784044416.085107:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581083008 00000100:00100000:3.0:1784044416.085117:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581082624 00000100:00100000:3.0:1784044416.085119:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581082624 00000100:00100000:3.0:1784044416.085131:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784044416.085136:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581082496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044416.091277:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044416.091368:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784044416.091391:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705581083008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044416.091399:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784044416.091413:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581082624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044416.093305:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705581083008:12345-0@lo:400:kworker.0 Request processed in 1919us (8268us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044416.093319:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784044416.093374:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581081984 00000100:00100000:0.0:1784044416.093383:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581081984 00000100:00100000:2.0:1784044416.093389:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581082624:12345-0@lo:400:kworker.0 Request processed in 1977us (8317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044416.093400:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1784044416.093429:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044416.093437:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044416.093442:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044416.093446:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044416.093448:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1784044416.093470:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3641:x1870705581081984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044416.093530:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3641:x1870705581081984:12345-0@lo:400:kworker.0 Request processed in 73us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044416.093535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044416.093544:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784044416.093586:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581082368 00000100:00100000:2.0:1784044416.093590:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581082368 00000100:00100000:0.0:1784044416.093622:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581081984:0@lo:400:kworker.0 00000100:00100000:2.0:1784044416.093628:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784044416.093636:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581082368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044416.093661:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581082112:0@lo:400:kworker.0 00000100:00100000:2.0:1784044416.093678:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581082368:12345-0@lo:400:kworker.0 Request processed in 41us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044416.093703:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784044416.093723:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784044416.093735:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581081856:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044416.093738:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581082368:0@lo:400:kworker.0 00000100:00100000:2.0:1784044416.093753:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705581082880:0@lo:400:kworker.0 00002000:00000024:0.0:1784044416.093762:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1784044416.093842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044416.094341:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581081856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 607us (16083us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044416.094350:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784044416.095092:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581082880 00000100:00100000:0.0:1784044416.095103:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581082880 00000100:00100000:3.0:1784044416.095659:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581082496:12345-0@lo:400:kworker.0 Request processed in 10518us (10676us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044416.095669:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784044416.095693:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784044416.095703:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705581082880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044416.095756:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705581082880:12345-0@lo:400:kworker.0 Request processed in 57us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044416.095762:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784044416.095812:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581082624:0@lo:400:kworker.0 00000100:00080000:0.0:1784044416.096242:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044416.096697:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581082496:0@lo:400:kworker.0 00010000:00080000:3.0:1784044416.096739:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9df100 x1870705581083008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044416.096750:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581083008:0@lo:400:kworker.0 00000100:00100000:1.0:1784044416.103448:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581081600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 24730us (25528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044416.103504:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784044416.103542:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705581082880:0@lo:400:kworker.0 00000100:00100000:2.0:1784044416.103581:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581081856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044416.103582:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581081600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044416.741521:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044416.741568:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044416.741599:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044416.741724:0:20342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565257984 00000100:00100000:3.0:1784044416.741735:0:20342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565257984 00000100:00100000:3.0:1784044416.741799:0:20342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565258112 00000100:00100000:3.0:1784044416.741802:0:20342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565258112 00000100:00100000:3.0:1784044416.741815:0:20342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565258240 00000100:00100000:3.0:1784044416.741818:0:20342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565258240 00000100:00100000:3.0:1784044416.741832:0:20342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:3.0:1784044416.741843:0:20342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cf001828-7720-4c65-ba45-a14bcd113197+12:2409:x1870705565257984:12345-192.168.202.40@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1784044416.741957:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1784044416.741966:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf001828-7720-4c65-ba45-a14bcd113197+12:2409:x1870705565258112:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044416.744676:0:20342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044416.744712:0:20342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b397cb19e00/0x89871fc3aba195f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a9f expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044416.744731:0:20342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044416.744803:0:20342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cf001828-7720-4c65-ba45-a14bcd113197+11:2409:x1870705565257984:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 2960us (3291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044416.744813:0:20342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:3.0:1784044416.744858:0:20342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:3.0:1784044416.744871:0:20342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cf001828-7720-4c65-ba45-a14bcd113197+10:2409:x1870705565258240:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044416.750483:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044416.750528:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7800/0x89871fc3aba195f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad0 expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044416.750549:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044416.750644:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf001828-7720-4c65-ba45-a14bcd113197+9:2409:x1870705565258112:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 8676us (9072us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044416.750658:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00010000:00010000:3.0:1784044416.756678:0:20342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044416.756722:0:20342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982055c00/0x89871fc3aba1966f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b0f expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044416.757574:0:20342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044416.757664:0:20342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cf001828-7720-4c65-ba45-a14bcd113197+7:2409:x1870705565258240:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 12795us (16061us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044416.757676:0:20342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1784044416.765054:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044416.767785:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565258496 00000100:00100000:2.0:1784044416.767807:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565258496 00000100:00100000:2.0:1784044416.767970:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:2.0:1784044416.767982:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2406:x1870705565258496:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:2.0:1784044416.768025:0:17199:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19606 00000020:00010000:2.0:1784044416.768034:0:17199:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b3947bb9800: total 0 00000100:00080000:2.0:1784044416.768040:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9b38423e7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044416.768076:0:17199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:1.0:1784044416.768417:0:17188:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b3947bb9800: total 0 00010000:00010000:1.0:1784044416.768497:0:17188:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b3947bb9800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784044416.768542:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3975b83400) 00010000:00010000:1.0:1784044416.768546:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044416.768557:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055200/0x89871fc3aba196fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b39 expref: 6 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044416.768591:0:17188:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b3947bb9800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784044416.768604:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044416.768606:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044416.768608:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044416.769567:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+3:2406:x1870705565258496:12345-192.168.202.40@tcp:39:umount.0 Request processed in 1581us (4516us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1784044416.769578:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00080000:0.0:1784044416.770104:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044416.784966:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044416.786416:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565258624 00000100:00100000:3.0:1784044416.786431:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565258624 00000100:00100000:3.0:1784044416.786523:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:3.0:1784044416.786535:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2406:x1870705565258624:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:3.0:1784044416.786575:0:17200:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1960d 00000100:00080000:3.0:1784044416.786583:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9b384242d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784044416.786617:0:17200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1784044416.786774:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+3:2406:x1870705565258624:12345-192.168.202.40@tcp:39:umount.0 Request processed in 240us (1818us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784044416.786782:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00080000:1.0:1784044416.787080:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784044416.787164:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044416.834140:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044416.834349:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565258880 00000100:00100000:0.0:1784044416.834360:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565258880 00000100:00100000:0.0:1784044416.834419:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:0.0:1784044416.834430:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+7:2406:x1870705565258880:12345-192.168.202.40@tcp:251:umount.0 00000020:00000080:0.0:1784044416.834492:0:17192:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba195a4 00000020:00010000:0.0:1784044416.834501:0:17192:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b3842445000: total 0 00000100:00080000:0.0:1784044416.834506:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9b3842440800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784044416.834571:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+3:2406:x1870705565258880:12345-192.168.202.40@tcp:251:umount.0 Request processed in 143us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044416.834579:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 182 00000020:00010000:2.0:1784044416.834911:0:20228:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b3842445000: total 0 00010000:00010000:2.0:1784044416.834917:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044416.834993:0:20228:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b3842445000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784044416.835038:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba195ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a28 expref: 2 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044416.835055:0:20228:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b3842445000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1784044416.835103:0:20228:0:(genops.c:906:class_export_put()) final put ffff9b3842445000/cf001828-7720-4c65-ba45-a14bcd113197 00010000:00010000:2.0:1784044416.835127:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044416.835129:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044416.835131:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784044416.836104:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842445000/cf001828-7720-4c65-ba45-a14bcd113197 for MGS 00000020:00000080:0.0:1784044416.836155:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3842440800 for MGS 00010000:00010000:1.0:1784044417.037566:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044418.068524:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784044418.603423:0:20775:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784044418.620672:0:20775:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1784044418.620738:0:20775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.620752:0:20775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.620759:0:20775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.620783:0:20775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.620851:0:20775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784044418.620858:0:20775:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784044418.620885:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784044418.620890:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784044418.620906:0:20775:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784044418.620934:0:20775:0:(import.c:65:import_set_state_nolock()) ffff9b394740b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784044418.624886:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581083136:0@lo:39:umount.0 00000100:00100000:0.0:1784044418.624967:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044418.626329:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581083136 00000100:00100000:1.0:1784044418.626343:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581083136 00000100:00100000:1.0:1784044418.626412:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784044418.626423:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397493b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870705581083136:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784044418.626485:0:17201:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19198 00000100:00080000:1.0:1784044418.626495:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9b384244e000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784044418.632760:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044418.632776:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.632790:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166bc00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044418.632795:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.632807:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044418.632817:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044418.632823:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784044418.632826:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784044418.632829:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784044418.632917:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.632924:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044418.632955:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.632963:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044418.633003:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044418.633025:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581083264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044418.633116:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044418.633199:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581083264 00000100:00100000:2.0:1784044418.633207:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581083264 00000100:00100000:2.0:1784044418.633268:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784044418.633278:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3640:x1870705581083264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044418.633294:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044418.633313:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843799c00/0x89871fc3aba1916e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba19167 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.633328:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044418.633363:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:3640:x1870705581083264:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044418.633371:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784044418.633415:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581083264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044418.633447:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044418.633450:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044418.633451:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044418.633801:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397493b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1870705581083136:12345-0@lo:39:umount.0 Request processed in 7379us (8832us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044418.633811:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000020:00000080:1.0:1784044418.633821:0:17201:0:(genops.c:906:class_export_put()) final put ffff9b384244c000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1784044418.633880:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b394740b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1784044418.634323:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784044418.634335:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384244c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784044418.634384:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b384244e000 for lustre-MDT0000 00000100:00100000:1.0:1784044418.635753:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581083136:0@lo:39:umount.0 00000100:00080000:1.0:1784044418.635818:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784044418.635825:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784044418.635831:0:20775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784044418.640783:0:20775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640815:0:20775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640823:0:20775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640831:0:20775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640850:0:20775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044418.640856:0:20775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640863:0:20775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640870:0:20775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640876:0:20775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640899:0:20775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784044418.640906:0:20775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640912:0:20775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640929:0:20775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640935:0:20775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640946:0:20775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784044418.640953:0:20775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640960:0:20775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640966:0:20775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640973:0:20775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044418.640983:0:20775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1784044418.640986:0:20775:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1784044418.641015:0:20775:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1784044418.641020:0:20775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1784044418.641023:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044418.641028:0:20775:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1784044418.641036:0:20775:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b38437dd800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784044418.641042:0:20775:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b38423e4000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784044418.641046:0:20775:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b396f25e000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784044418.641057:0:20775:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b39741f8000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784044418.641063:0:20775:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9b3947bb9800 35f5085c-0464-4087-9b4b-890cdd0735b4 192.168.202.40@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1784044418.641068:0:20775:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9b39741fc800 ffd836bb-8324-4bbb-bdb8-ace806f205ee 192.168.202.40@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:1.0:1784044418.641072:0:20775:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9b3843563380) has exports, disconnecting them 00000020:00080000:1.0:1784044418.641077:0:20775:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b38437dd800), last request at 1784044416 00000020:00000080:1.0:1784044418.641084:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19493 00000100:00080000:1.0:1784044418.641100:0:20775:0:(import.c:65:import_set_state_nolock()) ffff9b38437d8000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784044418.641140:0:20775:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b38437dd800): rc 0 00000020:00000080:1.0:1784044418.641143:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b38437dd800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1784044418.641152:0:20775:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b38423e4000), last request at 1784044416 00000020:00000080:1.0:1784044418.641155:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19335 00000100:00080000:1.0:1784044418.641160:0:20775:0:(import.c:65:import_set_state_nolock()) ffff9b38423e2000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784044418.641167:0:20775:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b38423e4000): rc 0 00000020:00000080:1.0:1784044418.641168:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b38423e4000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1784044418.641193:0:20775:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b396f25e000), last request at 1784044328 00000020:00000080:1.0:1784044418.641198:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19286 00000100:00080000:1.0:1784044418.641201:0:20775:0:(import.c:65:import_set_state_nolock()) ffff9b397f9eb800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784044418.641207:0:20775:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b396f25e000): rc 0 00000020:00000080:1.0:1784044418.641208:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b396f25e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1784044418.641212:0:20775:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b39741f8000), last request at 1784044328 00000020:00000080:1.0:1784044418.641216:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1922b 00000100:00080000:1.0:1784044418.641219:0:20775:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784044418.641225:0:20775:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00080000:1.0:1784044418.641293:0:20775:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b39741f8000): rc 0 00000004:00000080:1.0:1784044418.641299:0:20775:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb73bc8453ae0 00000100:00080000:1.0:1784044418.641316:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784044418.641325:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784044418.642059:0:20775:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784044418.642088:0:20775:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784044418.642135:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581083392:0@lo:39:umount.0 00000100:00100000:1.0:1784044418.642238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044418.642653:0:20228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784044418.642665:0:20228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642678:0:20228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fce00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044418.642697:0:20228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642710:0:20228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044418.642720:0:20228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044418.642727:0:20228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784044418.642729:0:20228:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1784044418.642733:0:20228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1784044418.642763:0:20228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642769:0:20228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044418.642800:0:20228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642809:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642825:0:20228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784044418.642829:0:20228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642836:0:20228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044418.642839:0:20228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642847:0:20228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044418.642860:0:20228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044418.642866:0:20228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1784044418.642868:0:20228:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1784044418.642871:0:20228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1784044418.642887:0:20228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642906:0:20228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044418.642913:0:20228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642919:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642929:0:20228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044418.642933:0:20228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642939:0:20228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc800 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044418.642942:0:20228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642949:0:20228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044418.642956:0:20228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044418.642972:0:20228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784044418.642975:0:20228:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784044418.642977:0:20228:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784044418.642991:0:20228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.642997:0:20228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044418.643013:0:20228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.643020:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.643029:0:20228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044418.643033:0:20228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.643039:0:20228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044418.643042:0:20228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.643048:0:20228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044418.643054:0:20228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044418.643059:0:20228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784044418.643062:0:20228:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1784044418.643064:0:20228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1784044418.643083:0:20228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.643089:0:20228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044418.643095:0:20228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.643102:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.643112:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044418.643114:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044418.643115:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044418.643226:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581083648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044418.643272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044418.643313:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044418.643319:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581083520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044418.643342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044418.643369:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581083776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044418.643391:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044418.643408:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044418.643413:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581083904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044418.643445:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044418.643477:0:20342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581083648 00000100:00100000:2.0:1784044418.643484:0:20342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581083648 00000100:00100000:2.0:1784044418.643532:0:20342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581083520 00000100:00100000:2.0:1784044418.643535:0:20342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581083520 00000100:00100000:2.0:1784044418.643548:0:20342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581083776 00000100:00100000:2.0:1784044418.643550:0:20342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581083776 00000100:00100000:2.0:1784044418.643558:0:20342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581083904 00000100:00100000:2.0:1784044418.643570:0:20342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581083904 00000100:00100000:2.0:1784044418.643590:0:20342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784044418.643598:0:20342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99a46fb7-9af9-40f1-9c76-329d6781ee81+26:3639:x1870705581083648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044418.643611:0:20342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044418.643628:0:20342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982054600/0x89871fc3aba194cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba194c4 expref: 26 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.643645:0:20342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044418.643682:0:20342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99a46fb7-9af9-40f1-9c76-329d6781ee81+25:3639:x1870705581083648:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044418.643690:0:20342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784044418.643708:0:20342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784044418.643714:0:20342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b96ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3639:x1870705581083520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044418.643722:0:20342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044418.643730:0:20342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166b600/0x89871fc3aba190bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba190b8 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.643738:0:20342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044418.643754:0:20342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b96ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:3639:x1870705581083520:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044418.643759:0:20342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784044418.643790:0:20342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044418.643795:0:20342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:3640:x1870705581083776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044418.643800:0:20342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044418.643807:0:20342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b397cb19000/0x89871fc3aba19668 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba19661 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.643814:0:20342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044418.643840:0:20342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3640:x1870705581083776:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044418.643846:0:20342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044418.643856:0:20342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044418.643861:0:20342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:3640:x1870705581083904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044418.643867:0:20342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044418.643874:0:20342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166a400/0x89871fc3aba190b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba190aa expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044418.643882:0:20342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044418.643897:0:20342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:3640:x1870705581083904:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044418.643902:0:20342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044418.643935:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581083520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044418.643943:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581083648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044418.643963:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581083904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044418.643970:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581083776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044418.643996:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044418.644325:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044418.644396:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784044418.644410:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b38437dd800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784044418.644482:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b38423e4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784044418.644506:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f25e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784044418.644529:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b38437d8000 for lustre-MDT0000 00000020:00000080:0.0:1784044418.644533:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b38423e2000 for lustre-MDT0000 00000020:00000080:0.0:1784044418.644536:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397f9eb800 for lustre-MDT0000 00000100:00100000:0.0:1784044418.644552:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581083392 00000100:00100000:0.0:1784044418.644557:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581083392 00000100:00100000:0.0:1784044418.644591:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784044418.644611:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870705581083392:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784044418.644637:0:17205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba192b0 00000100:00080000:0.0:1784044418.644645:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9b395820f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784044418.644668:0:17205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1784044418.644808:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3637:x1870705581083392:12345-0@lo:39:umount.0 Request processed in 210us (2569us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1784044418.644815:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:0.0:1784044418.644840:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044418.644866:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784044418.644873:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581083392:0@lo:39:umount.0 00000100:00080000:1.0:1784044418.645329:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784044418.645333:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1784044418.645399:0:20775:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784044418.645468:0:20775:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1784044418.645490:0:20775:0:(import.c:65:import_set_state_nolock()) ffff9b396f25c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784044418.645509:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784044418.645511:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1784044418.645524:0:20775:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784044418.645594:0:20775:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784044418.645614:0:20775:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1784044418.645655:0:20775:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b3843563380) has no exports 00000100:00100000:0.0:1784044418.645764:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581084032:0@lo:9:umount.0 00000100:00100000:0.0:1784044418.645807:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044418.645840:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581084160:0@lo:9:umount.0 00000100:00100000:0.0:1784044418.645861:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044418.645907:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581084032 00000100:00100000:0.0:1784044418.645913:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581084032 00000100:00100000:0.0:1784044418.645959:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581084160 00000100:00100000:0.0:1784044418.645977:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581084160 00000100:00100000:0.0:1784044418.646002:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784044418.646011:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1870705581084032:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784044418.646029:0:18933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1937b 00000100:00080000:0.0:1784044418.646037:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9b38423e1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784044418.646082:0:18933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1784044418.646364:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3637:x1870705581084032:12345-0@lo:9:umount.0 Request processed in 353us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044418.646372:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784044418.646386:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784044418.646392:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1870705581084160:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784044418.646404:0:18933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba194d2 00000100:00080000:0.0:1784044418.646409:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9b3947bbc800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784044418.646433:0:18933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1784044418.646524:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3637:x1870705581084160:12345-0@lo:9:umount.0 Request processed in 132us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044418.646530:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1784044418.646549:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044418.646553:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784044418.646568:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044418.646593:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b396f25c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1784044418.651388:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784044418.651569:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784044418.651577:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784044418.651588:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581084032:0@lo:9:umount.0 00000100:00080000:0.0:1784044418.651654:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784044418.651667:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784044418.651668:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784044418.651672:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581084160:0@lo:9:umount.0 00000020:00080000:1.0:1784044418.662734:0:20775:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b3843563380) has no exports 00000020:00000080:1.0:1784044418.725948:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19105 00000020:00000080:1.0:1784044418.725967:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b3843441000/lustre-QMT0000_UUID 00000020:01000000:1.0:1784044418.726022:0:20775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784044418.726096:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843441000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784044418.726509:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044418.726520:0:20775:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784044418.726525:0:20775:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9b38424519c0) has no exports 00000020:00000080:0.0:1784044418.726752:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba190fe 00000020:00000080:0.0:1784044418.726759:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b39459d5800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784044418.726824:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044418.726832:0:20775:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784044418.726834:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b39459d3800/lustre-QMT0000_UUID 00000020:00000080:0.0:1784044418.726837:0:20775:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39459d3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1784044418.726844:0:20775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1784044418.726975:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39459d5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1784044419.088009:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784044419.666749:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784044419.666765:0:17933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1784044419.666770:0:17933:0:(genops.c:906:class_export_put()) final put ffff9b3842083800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784044419.666804:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 35f5085c-0464-4087-9b4b-890cdd0735b4 00000001:00080000:3.0:1784044419.666811:0:17933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1784044419.666814:0:17933:0:(genops.c:906:class_export_put()) final put ffff9b3842429800/35f5085c-0464-4087-9b4b-890cdd0735b4 00000001:00100000:3.0:1784044419.666819:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000001:00080000:3.0:1784044419.666823:0:17933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1784044419.666824:0:17933:0:(genops.c:906:class_export_put()) final put ffff9b39741fc000/ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000020:00000080:0.0:1784044419.666904:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842083800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1784044419.666968:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842429800/35f5085c-0464-4087-9b4b-890cdd0735b4 for lustre-MDT0001 00000020:00000080:0.0:1784044419.666990:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39741fc000/ffd836bb-8324-4bbb-bdb8-ace806f205ee for lustre-MDT0001 00000020:00000080:0.0:1784044419.667077:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b395820f800 for lustre-MDT0001 00000020:00000080:0.0:1784044419.667083:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b384242d800 for lustre-MDT0001 00000020:00000080:0.0:1784044419.667087:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b39749de800 for lustre-MDT0001 00000001:00100000:3.0:1784044419.667232:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784044419.667237:0:19522:0:(genops.c:906:class_export_put()) final put ffff9b3947bbc000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784044419.667255:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000020:00000080:3.0:1784044419.667258:0:19522:0:(genops.c:906:class_export_put()) final put ffff9b3947bbd800/ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000020:00000080:2.0:1784044419.667346:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3947bbc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784044419.667378:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3947bbd800/ffd836bb-8324-4bbb-bdb8-ace806f205ee for lustre-OST0001 00000020:00000080:2.0:1784044419.667393:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3947bbc800 for lustre-OST0001 00000020:00000080:2.0:1784044419.667397:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3947bbf800 for lustre-OST0001 00000001:00100000:1.0:1784044419.670059:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784044419.670068:0:17179:0:(genops.c:906:class_export_put()) final put ffff9b39741f8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784044419.670136:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39741f8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1784044419.670215:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3970ff2000 for lustre-MDT0000 00000001:00100000:1.0:1784044419.670949:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35f5085c-0464-4087-9b4b-890cdd0735b4 00000001:00080000:1.0:1784044419.670959:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1784044419.670962:0:17179:0:(genops.c:906:class_export_put()) final put ffff9b3947bb9800/35f5085c-0464-4087-9b4b-890cdd0735b4 00000001:00100000:1.0:1784044419.670981:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000001:00080000:1.0:1784044419.670985:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:1.0:1784044419.670991:0:17179:0:(genops.c:906:class_export_put()) final put ffff9b39741fc800/ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000020:00000080:2.0:1784044419.671089:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3947bb9800/35f5085c-0464-4087-9b4b-890cdd0735b4 for lustre-MDT0000 00000020:00000080:2.0:1784044419.671322:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39741fc800/ffd836bb-8324-4bbb-bdb8-ace806f205ee for lustre-MDT0000 00000020:00000080:2.0:1784044419.671450:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b38423e7000 for lustre-MDT0000 00000020:00000080:2.0:1784044419.671456:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b39741fd000 for lustre-MDT0000 00000040:00080000:1.0:1784044420.046278:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784044420.111671:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044420.174080:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581084288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044420.174153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044420.174367:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581084288 00000100:00100000:1.0:1784044420.174376:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581084288 00000100:00100000:1.0:1784044420.174455:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784044420.174465:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581084288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044420.174498:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044420.174548:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581084288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044420.174556:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784044420.174603:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581084288:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784044420.174707:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:1.0:1784044420.749639:0:20775:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b38423371e0 - data ffff9b395d4936c0/ffff9b38437f8c00 00000020:01000000:1.0:1784044420.750056:0:20775:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b397fa7f960 - data ffff9b395d420510/ffff9b39760bf400 00000001:00000004:1.0:1784044420.761780:0:20775:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:3.0:1784044420.838197:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784044420.838209:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784044420.838224:0:20775:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9b384316ca80 x1870705581083392/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784044428 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044420.838248:0:20775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1784044420.842048:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784044420.842058:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1784044420.842405:0:20775:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784044420.842408:0:20775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784044420.843806:0:17224:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784044420.843813:0:17224:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1784044420.843826:0:17224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1784044420.845756:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784044420.845764:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1784044420.845787:0:20775:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784044420.845790:0:20775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784044420.847607:0:17226:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784044420.847615:0:17226:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1784044420.847629:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1784044420.851002:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba190cd 00000020:00000080:3.0:1784044420.851015:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b3944fd1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784044420.851227:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3944fd1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784044420.853241:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba190e2 00000020:00000080:3.0:1784044420.853254:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b3974dac000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784044420.853274:0:20775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1784044420.853278:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044420.853286:0:20775:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784044420.853291:0:20775:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9b3843560000) has no exports 00000004:01000000:3.0:1784044420.853778:0:20775:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784044420.853788:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19144 00000020:00000080:3.0:1784044420.853793:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b384244b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784044420.853810:0:20775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784044420.853813:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044420.853819:0:20775:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784044420.853821:0:20775:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9b3842453380) has no exports 00000020:00000080:3.0:1784044420.853828:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1913d 00000020:00000080:3.0:1784044420.853833:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b397b801800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1784044420.854234:0:20775:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784044420.854239:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784044420.854244:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1784044420.854262:0:20775:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784044420.854265:0:20775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784044420.854300:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044420.854824:0:20775:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044420.854837:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1912f 00000020:00000080:3.0:1784044420.854844:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b397b807000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784044420.854850:0:20775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784044420.854857:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044420.854861:0:20775:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784044420.854864:0:20775:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9b3974253380) has no exports 00000020:00000080:3.0:1784044420.854870:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19128 00000020:00000080:3.0:1784044420.854875:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b396f258000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1784044420.855479:0:20775:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784044420.855483:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784044420.855487:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1784044420.855492:0:20775:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784044420.855494:0:20775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784044420.855525:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044420.855530:0:20775:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1784044420.855544:0:20775:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1784044420.855550:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1911a 00000020:00000080:3.0:1784044420.855556:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b3974daf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784044420.855561:0:20775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1784044420.855585:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044420.855589:0:20775:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784044420.855591:0:20775:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9b3974250000) has no exports 00000020:00000080:3.0:1784044420.855596:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19113 00000020:00000080:3.0:1784044420.855600:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b3974da8000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784044420.855920:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974dac000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1784044420.855933:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384244b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784044420.855937:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b801800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784044420.855942:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397b804800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784044420.855947:0:36:0:(genops.c:906:class_export_put()) final put ffff9b397b806000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784044420.855949:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b806000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784044420.855954:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784044420.856035:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b807000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784044420.856040:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f258000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784044420.856049:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b396f25c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784044420.856053:0:36:0:(genops.c:906:class_export_put()) final put ffff9b3974da8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784044420.856055:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974da8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784044420.856057:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784044420.856085:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974daf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784044420.856089:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974da8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784044420.968933:0:20775:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1784044420.968944:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784044420.968949:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784044420.968958:0:20775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784044420.969020:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044420.969033:0:20775:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044420.969062:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044420.969065:0:20775:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044420.969072:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b397ab0d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784044420.969087:0:20775:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397ab0d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784044420.969101:0:20775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044420.969246:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba190e9 00000020:00000080:1.0:1784044420.969370:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3974dac800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784044420.969377:0:36:0:(genops.c:906:class_export_put()) final put ffff9b3974dab800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784044420.969380:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974dab800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1784044420.969388:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044420.969652:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b3974da9800/lustre-MDD0000_UUID 00000020:01000000:3.0:1784044420.969668:0:20775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1784044420.969673:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044420.969679:0:20775:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784044420.969684:0:20775:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9b38435619c0) has no exports 00000020:00000080:3.0:1784044420.969707:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044420.969710:0:20775:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1784044420.969714:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba190f0 00000020:00000080:3.0:1784044420.969719:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b3974daa000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784044420.969727:0:20775:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b397a8e8000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1784044420.969730:0:20775:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b397a8e8000 3 00000020:01000004:3.0:1784044420.969733:0:20775:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b397a8e8000 from lustre-MDT0000 00000020:00000080:3.0:1784044420.969750:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044420.969753:0:20775:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1784044420.969755:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b3944fd7800/lustre-MDT0000_UUID 00000020:00000080:3.0:1784044420.969767:0:20775:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3944fd7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1784044420.969774:0:20775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1784044420.969808:0:20775:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1784044420.969812:0:20775:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1784044420.969815:0:20775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1784044420.969817:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044420.969820:0:20775:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784044420.969827:0:20775:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9b384447c800 99a46fb7-9af9-40f1-9c76-329d6781ee81 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784044420.969832:0:20775:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9b384304b380) has exports, disconnecting them 00000020:00080000:3.0:1784044420.969836:0:20775:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b384447c800), last request at 1784044312 00000020:00000080:3.0:1784044420.969851:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19095 00000020:00010000:3.0:1784044420.969855:0:20775:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b384447c800: total 2 00000100:00080000:3.0:1784044420.969859:0:20775:0:(import.c:65:import_set_state_nolock()) ffff9b384447a000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784044420.969910:0:20775:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b384447c800): rc 0 00000020:00080000:3.0:1784044420.969914:0:20775:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9b384304b380) has no exports 00000100:00100000:3.0:1784044420.969965:0:17194:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b395261b600:17194] 2 exiting: rc = 0 00000020:00000080:1.0:1784044420.970086:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974da9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1784044420.970090:0:36:0:(genops.c:906:class_export_put()) final put ffff9b3944fd5000/lustre-MDD0000_UUID 00000020:00000080:1.0:1784044420.970092:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3944fd5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784044420.970096:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1784044420.970130:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974daa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1784044420.970166:0:17193:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b3843c68000:17193] 1 exiting: rc = 0 00000100:00100000:1.0:1784044420.970296:0:17192:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b39758e3a00:17192] 0 exiting: rc = 1 00000100:00100000:3.0:1784044420.970586:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970593:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970599:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970605:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970609:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970614:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970619:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970624:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970630:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970636:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970640:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970646:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970651:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970655:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970660:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970664:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970669:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970683:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970688:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970693:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970699:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970704:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970709:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970715:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970720:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970725:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970731:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970736:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970742:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970747:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970753:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970757:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970763:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970768:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970775:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970780:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970785:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970791:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970797:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970802:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970808:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970813:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970818:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970823:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970828:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970833:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970840:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970845:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970850:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970855:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970861:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970866:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970878:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970883:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970888:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970894:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970899:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970904:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970909:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970914:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970919:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970924:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970929:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044420.970935:0:20775:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1784044420.972396:0:17188:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b384447c800: total 0 00010000:00010000:0.0:1784044420.972461:0:17188:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b384447c800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1784044420.972496:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b397cb19c00/0x89871fc3aba19454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba1944d expref: 14 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972515:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843798200/0x89871fc3aba192f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba192ef expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972540:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b6600/0x89871fc3aba191d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba191c9 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972552:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843799200/0x89871fc3aba1947e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba19477 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972562:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166ba00/0x89871fc3aba190a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba1909c expref: 10 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972649:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7200/0x89871fc3aba194bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba194b6 expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972664:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38426fde00/0x89871fc3aba1963e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba19637 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972676:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38426fc600/0x89871fc3aba191b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba191ad expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972689:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7400/0x89871fc3aba19320 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba19319 expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972700:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba1964c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba19645 expref: 5 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972711:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38426fdc00/0x89871fc3aba19271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba1926a expref: 4 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972723:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843799a00/0x89871fc3aba191c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba191bb expref: 3 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972749:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba1965a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba19653 expref: 2 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044420.972760:0:17188:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b384447c800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1784044420.972775:0:17188:0:(genops.c:906:class_export_put()) final put ffff9b384447c800/99a46fb7-9af9-40f1-9c76-329d6781ee81 00010000:00010000:0.0:1784044420.972798:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044420.972800:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044420.972802:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784044420.972842:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384447c800/99a46fb7-9af9-40f1-9c76-329d6781ee81 for MGS 00000020:00000080:3.0:1784044420.972879:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b384447a000 for MGS 00000020:01000000:3.0:1784044420.973814:0:20775:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b3974d25660 - data ffff9b395d4b3510/ffff9b38437fc000 00000020:01000000:3.0:1784044420.973947:0:20775:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b397fa7f120 - data ffff9b3951bf0438/ffff9b3843ea7c00 00000020:00000080:3.0:1784044420.974519:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19079 00000020:00000080:3.0:1784044420.974529:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b3952666000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784044420.974545:0:20775:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b397a8e8000 from MGS, refs=2 00000020:01000004:3.0:1784044420.974549:0:20775:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b397a8e8000 2 00000020:01000004:3.0:1784044420.974552:0:20775:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b397a8e8000 from MGS 00000020:00000080:3.0:1784044420.974650:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044420.974657:0:20775:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1784044420.974660:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b3952660000/MGS 00000020:00000080:3.0:1784044420.974663:0:20775:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3952660000/MGS for MGS 00000020:01000000:3.0:1784044420.974668:0:20775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1784044420.974733:0:20775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1784044420.974738:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044420.974743:0:20775:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784044420.974750:0:20775:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b394740a000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784044420.974756:0:20775:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9b38430499c0) has exports, disconnecting them 00000020:00080000:3.0:1784044420.974761:0:20775:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b394740a000), last request at 1784044312 00000020:00000080:3.0:1784044420.974776:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1917c 00000020:00080000:3.0:1784044420.974786:0:20775:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b394740a000): rc 0 00000020:00000080:3.0:1784044420.974790:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b394740a000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784044420.975364:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3952666000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784044420.975380:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b394740a000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1784044420.989128:0:20775:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1784044420.989137:0:20775:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784044420.989141:0:20775:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784044420.989149:0:20775:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784044420.989550:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044420.989561:0:20775:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1784044420.989706:0:20775:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b397a8e8000 1 00000020:00000080:3.0:1784044420.989714:0:20775:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1906b 00000020:00000080:3.0:1784044420.989723:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b3952667800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784044420.989743:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b394740b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784044420.989750:0:37:0:(genops.c:906:class_export_put()) final put ffff9b394740e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784044420.989752:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b394740e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784044420.989758:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1784044420.990156:0:20775:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1784044420.990162:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044420.990166:0:20775:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784044420.990170:0:20775:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9b38421119c0) has no exports 00000020:00000080:0.0:1784044420.992693:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3952667800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784044421.040719:0:20775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044421.040735:0:20775:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784044421.040741:0:20775:0:(genops.c:906:class_export_put()) final put ffff9b397a8ef000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784044421.040747:0:20775:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397a8ef000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784044421.040759:0:20775:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784044421.040883:0:20775:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b397a8ee000 00000020:02000400:1.0:1784044421.040964:0:20775:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1784044421.136007:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044421.200378:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581084800:0@lo:400:kworker.0 00000100:00100000:3.0:1784044421.200464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044421.200498:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581085312:0@lo:400:kworker.0 00000100:00100000:3.0:1784044421.200523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044421.200549:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784044421.200555:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581084416:0@lo:400:kworker.0 00000400:00000100:3.0:1784044421.200575:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705581084416 offset 0 length 224: 4 00000100:00100000:3.0:1784044421.200596:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581084928:0@lo:400:kworker.0 00000100:00100000:3.0:1784044421.200617:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044421.200633:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581085440:0@lo:400:kworker.0 00000100:00100000:3.0:1784044421.200652:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044421.200688:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581084544:0@lo:400:kworker.0 00000100:00100000:3.0:1784044421.200714:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044421.200730:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581085056:0@lo:400:kworker.0 00000100:00100000:3.0:1784044421.200749:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044421.200765:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784044421.200770:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581084672:0@lo:400:kworker.0 00000100:00100000:3.0:1784044421.200790:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044421.200803:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581085184:0@lo:400:kworker.0 00000100:00100000:3.0:1784044421.200824:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044421.200856:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581085312 00000100:00100000:3.0:1784044421.200864:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581085312 00000100:00100000:3.0:1784044421.200896:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581084928 00000100:00100000:3.0:1784044421.200899:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581084928 00000100:00100000:3.0:1784044421.200906:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581085440 00000100:00100000:3.0:1784044421.200908:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581085440 00000100:00100000:3.0:1784044421.200932:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581085056 00000100:00100000:3.0:1784044421.200935:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581085056 00000100:00100000:3.0:1784044421.200941:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581085184 00000100:00100000:3.0:1784044421.200943:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581085184 00000100:00100000:3.0:1784044421.200959:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784044421.200968:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581085440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044421.201022:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581085440:12345-0@lo:400:kworker.0 Request processed in 54us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044421.201030:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784044421.201051:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784044421.201057:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581085184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044421.201093:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581085184:12345-0@lo:400:kworker.0 Request processed in 37us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044421.201108:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784044421.201122:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784044421.201126:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1870705581085312:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784044421.201131:0:17199:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784044421.201193:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1870705581085312:12345-0@lo:400:kworker.0 Request processed in 44us (648us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784044421.201200:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784044421.201214:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784044421.201218:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1870705581084928:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784044421.201222:0:17199:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784044421.201245:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1870705581084928:12345-0@lo:400:kworker.0 Request processed in 26us (628us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784044421.201251:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784044421.201262:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784044421.201266:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1870705581085056:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784044421.201269:0:17199:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784044421.201290:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1870705581085056:12345-0@lo:400:kworker.0 Request processed in 23us (540us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784044421.201296:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1784044421.201340:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9b397f9dc700 x1870705581085184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044421.201360:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581085184:0@lo:400:kworker.0 00000100:00080000:3.0:1784044421.201373:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784044421.201378:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b38423e1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784044421.201382:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1784044421.203603:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581084800 00000100:00100000:0.0:1784044421.203616:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581084800 00000100:00100000:0.0:1784044421.203672:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581084672 00000100:00100000:0.0:1784044421.203675:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581084672 00000100:00100000:0.0:1784044421.203698:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784044421.203706:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581084800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044421.203785:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581084800:12345-0@lo:400:kworker.0 Request processed in 79us (3321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044421.203793:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784044421.203810:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784044421.203816:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581084672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044421.203863:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581084672:12345-0@lo:400:kworker.0 Request processed in 47us (3072us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044421.203869:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784044421.203897:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581084544 00000100:00100000:0.0:1784044421.203901:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581084544 00000100:00100000:0.0:1784044421.203922:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784044421.203926:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1870705581084544:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784044421.203931:0:17205:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784044421.203958:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1870705581084544:12345-0@lo:400:kworker.0 Request processed in 30us (3243us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784044421.203964:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1784044421.203985:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044421.203990:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044421.216370:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784044421.216380:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9b3974dae800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784044421.216385:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784044421.216391:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9b3974dae800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044421.216395:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 522 00000100:00080000:2.0:1784044421.216405:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b3974dae800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044421.216453:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843d4ed80 x1870705581085696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044421.216486:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581084928:0@lo:400:kworker.0 00010000:00080000:2.0:1784044421.216506:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9b397f9de680 x1870705581085440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044421.216519:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581085440:0@lo:400:kworker.0 00000100:00100000:2.0:1784044421.216533:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581084800:0@lo:400:kworker.0 00000100:00080000:2.0:1784044421.216543:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784044421.216546:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9b39513bb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784044421.216549:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784044421.216552:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9b39513bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044421.216555:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 562 00000100:00080000:2.0:1784044421.216559:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b39513bb000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044421.216585:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843d4f100 x1870705581085824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044421.216596:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581085312:0@lo:400:kworker.0 00000100:00100000:0.0:1784044421.217325:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581085696:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784044421.217405:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044421.217531:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581085824:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784044421.217572:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784044421.220670:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b38423e1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044421.220682:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 540 00000100:00080000:3.0:1784044421.220692:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b38423e1800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044421.220736:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581085952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044421.220808:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044421.220849:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044421.220857:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581085568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044421.220884:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044421.220917:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581085952 00000100:00100000:3.0:1784044421.220924:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581085952 00000100:00100000:3.0:1784044421.220964:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784044421.220972:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1870705581085952:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1784044421.220981:0:17205:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784044421.221022:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1870705581085952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (213us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784044421.221029:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:02020000:3.0:1784044421.221075:0:3641:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1784044421.221697:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581085568 00000100:00100000:1.0:1784044421.221703:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581085568 00000100:00100000:1.0:1784044421.221738:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784044421.221745:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581085568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044421.221788:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784044421.221833:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581085568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044421.221839:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784044421.229637:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581085696 00000100:00100000:2.0:1784044421.229655:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581085696 00000100:00100000:2.0:1784044421.229710:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581085824 00000100:00100000:2.0:1784044421.229714:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581085824 00000100:00100000:2.0:1784044421.229737:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784044421.229746:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581085696:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1784044421.229770:0:17199:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784044421.229873:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581085696:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 126us (12467us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784044421.229880:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784044421.229897:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784044421.229901:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581085824:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1784044421.229911:0:17199:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784044421.229933:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581085824:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 31us (12361us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784044421.229938:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1784044421.233529:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974dae800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044421.233545:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784044421.233551:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581085696:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1784044421.233569:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39513bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044421.233573:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784044421.233576:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581085824:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784044421.253061:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b2300 x1870705581086080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044421.253116:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581085056:0@lo:400:kworker.0 00000100:00100000:0.0:1784044421.253196:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581084672:0@lo:400:kworker.0 00000100:00080000:0.0:1784044421.253210:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784044421.253215:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784044421.253219:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784044421.253224:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044421.253227:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:0.0:1784044421.253236:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b3970ff5000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044421.253249:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b3b80 x1870705581086208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044421.253260:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581084544:0@lo:400:kworker.0 00000100:00100000:1.0:1784044421.253431:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581086080:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1784044421.253501:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044421.253534:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581086208:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1784044421.253561:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044421.253601:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581086208 00000100:00100000:1.0:1784044421.253607:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581086208 00000100:00100000:1.0:1784044421.253644:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784044421.253653:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581086208:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1784044421.253675:0:17205:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784044421.253715:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581086208:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 62us (153us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784044421.253722:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1784044421.253755:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044421.253759:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044421.253762:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581086208:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784044421.254260:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581086080 00000100:00100000:2.0:1784044421.254266:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581086080 00000100:00100000:2.0:1784044421.254295:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784044421.254301:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1870705581086080:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1784044421.254314:0:17201:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784044421.254350:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1870705581086080:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 48us (849us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784044421.254367:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1784044421.254863:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b38423e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044421.254869:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044421.254873:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581086080:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1784044421.267446:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784044421.267454:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9b3970ff5000 already not connected (conn 2, was 1): DISCONN 00000100:00100000:2.0:1784044421.275567:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581085568:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1784044422.167054:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044423.188506:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044424.208534:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784044424.788995:0:18702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784044424.789006:0:18702:0:(genops.c:906:class_export_put()) final put ffff9b38423e6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784044424.789302:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b38423e6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784044424.789352:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b38423e1000 for lustre-OST0000 00000020:01000004:1.0:1784044424.876314:0:20976:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784044424.897333:0:20976:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1784044424.897411:0:20976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.897426:0:20976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.897434:0:20976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.897441:0:20976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.897466:0:20976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784044424.897472:0:20976:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784044424.897502:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784044424.897507:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784044424.897513:0:20976:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784044424.897520:0:20976:0:(import.c:65:import_set_state_nolock()) ffff9b3974dae800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1784044424.897525:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784044424.897526:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784044424.897530:0:20976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784044424.898447:0:20976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898460:0:20976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898467:0:20976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898489:0:20976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898505:0:20976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784044424.898512:0:20976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898518:0:20976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898525:0:20976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898531:0:20976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898545:0:20976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784044424.898551:0:20976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898558:0:20976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898564:0:20976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898570:0:20976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898595:0:20976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1784044424.898601:0:20976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898608:0:20976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898614:0:20976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898620:0:20976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044424.898627:0:20976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1784044424.898630:0:20976:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1784044424.898656:0:20976:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1784044424.898661:0:20976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1784044424.898665:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044424.898671:0:20976:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1784044424.898678:0:20976:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9b38437d8800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784044424.898684:0:20976:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9b384242d000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784044424.898689:0:20976:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9b3974da19c0) has exports, disconnecting them 00000020:00080000:1.0:1784044424.898694:0:20976:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9b38437d8800), last request at 1784044421 00000020:00000080:1.0:1784044424.898700:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba194a8 00000100:00080000:1.0:1784044424.898721:0:20976:0:(import.c:65:import_set_state_nolock()) ffff9b38437df800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784044424.898774:0:20976:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b38437d8800): rc 0 00000020:00000080:1.0:1784044424.898777:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b38437d8800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1784044424.898788:0:20976:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9b384242d000), last request at 1784044421 00000020:00000080:1.0:1784044424.898798:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19351 00000100:00080000:1.0:1784044424.898804:0:20976:0:(import.c:65:import_set_state_nolock()) ffff9b3842428800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1784044424.898816:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b38437d8800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1784044424.898882:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b38437df800 for lustre-MDT0001 00000020:00080000:1.0:1784044424.898897:0:20976:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b384242d000): rc 0 00000020:00000080:1.0:1784044424.898899:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b384242d000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1784044424.898911:0:20976:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb73bc1ce3ae0 00000020:00000080:1.0:1784044424.898921:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384242d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1784044424.898944:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3842428800 for lustre-MDT0001 00000100:00080000:1.0:1784044424.898963:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784044424.898974:0:20976:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9b384316dc00 x1870705581085952/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784044437 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044424.898989:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784044424.899851:0:20976:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784044424.899856:0:20976:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff5000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1784044424.900285:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784044424.900295:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900305:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fca00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044424.900308:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900318:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044424.900326:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044424.900344:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044424.900347:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784044424.900350:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784044424.900395:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900402:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044424.900433:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900440:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900453:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784044424.900456:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900462:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ae00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044424.900465:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900472:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044424.900478:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044424.900483:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044424.900485:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1784044424.900493:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1784044424.900509:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900515:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044424.900522:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900527:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900538:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784044424.900541:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900547:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044424.900550:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900557:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044424.900563:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044424.900569:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044424.900571:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1784044424.900572:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1784044424.900583:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900589:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044424.900620:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900628:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900641:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044424.900644:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900650:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18c00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044424.900653:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900660:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044424.900666:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044424.900671:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784044424.900673:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784044424.900675:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784044424.900689:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900695:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044424.900700:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900706:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900725:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044424.900729:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900735:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b800 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044424.900737:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900743:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044424.900748:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044424.900753:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044424.900755:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1784044424.900757:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1784044424.900769:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900775:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044424.900780:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900785:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044424.900795:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044424.900797:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044424.900804:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044424.900812:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044424.901002:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581086336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044424.901066:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044424.901302:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581086464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044424.901331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044424.901367:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581086592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044424.901400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044424.901418:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044424.901424:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581086720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044424.901444:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044424.901476:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581086336 00000100:00100000:0.0:1784044424.901484:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581086336 00000100:00100000:0.0:1784044424.901514:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581086464 00000100:00100000:0.0:1784044424.901517:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581086464 00000100:00100000:0.0:1784044424.901526:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581086592 00000100:00100000:0.0:1784044424.901528:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581086592 00000100:00100000:0.0:1784044424.901534:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581086720 00000100:00100000:0.0:1784044424.901536:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581086720 00000100:00100000:0.0:1784044424.901548:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044424.901555:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3638:x1870705581086336:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784044424.901561:0:17185:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784044424 with bad export cookie 9909924430310641813 00000100:00100000:3.0:1784044424.902300:0:20342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784044424.902307:0:20342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3639:x1870705581086464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784044424.902313:0:20342:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784044424 with bad export cookie 9909924430310641813 00000100:00100000:3.0:1784044424.902368:0:20342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3639:x1870705581086464:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1036us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784044424.902396:0:20342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784044424.902418:0:20342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044424.902423:0:20342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3640:x1870705581086592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784044424.902427:0:20342:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784044424 with bad export cookie 9909924430310641813 00000100:00100000:3.0:1784044424.902461:0:20342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3640:x1870705581086592:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (1061us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784044424.902468:0:20342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044424.902481:0:20342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784044424.902485:0:20342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3640:x1870705581086720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784044424.902489:0:20342:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784044424 with bad export cookie 9909924430310641813 00000100:00100000:3.0:1784044424.902515:0:20342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3640:x1870705581086720:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (1070us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784044424.902521:0:20342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1784044424.902551:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784044424.902556:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9b384447b800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1784044424.902560:0:3639:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1784044424.904861:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044424.904872:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044424.904897:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581085952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044424.910806:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3638:x1870705581086336:12345-0@lo:103:ldlm_bl.0 Request processed in 9242us (9732us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784044424.910820:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1784044424.911584:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784044424.911590:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1784044424.911621:0:20976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1784044424.911684:0:20976:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1784044424.911710:0:20976:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff4800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1784044424.911727:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784044424.911744:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1784044424.911770:0:20976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784044424.912237:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784044424.912360:0:20976:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1784044424.912374:0:20976:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1784044424.912427:0:20976:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9b3974da19c0) has no exports 00000100:00100000:0.0:1784044424.916292:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581086976:0@lo:9:umount.0 00000100:00100000:0.0:1784044424.916389:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044424.916433:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581087104:0@lo:9:umount.0 00000100:00100000:0.0:1784044424.916456:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044424.916495:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581086976 00000100:00100000:0.0:1784044424.916503:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581086976 00000100:00100000:0.0:1784044424.916556:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581087104 00000100:00100000:0.0:1784044424.916560:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581087104 00000100:00100000:0.0:1784044424.916579:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784044424.916586:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1870705581086976:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784044424.916624:0:18933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19374 00000100:00080000:0.0:1784044424.916633:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9b3842441000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784044424.916674:0:18933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1784044424.916812:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3637:x1870705581086976:12345-0@lo:9:umount.0 Request processed in 225us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044424.916820:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784044424.916851:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784044424.916858:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1870705581087104:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784044424.916870:0:18933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba194d9 00000100:00080000:0.0:1784044424.916876:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9b3947bba800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784044424.916895:0:18933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1784044424.916970:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3637:x1870705581087104:12345-0@lo:9:umount.0 Request processed in 112us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044424.916992:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1784044424.917014:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044424.917018:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784044424.917034:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044424.917063:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff4800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784044424.917080:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784044424.917082:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784044424.917086:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581086976:0@lo:9:umount.0 00000100:00080000:0.0:1784044424.917097:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784044424.917106:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784044424.917108:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784044424.917110:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581087104:0@lo:9:umount.0 00010000:00010000:0.0:1784044424.917153:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044424.923361:0:3639:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.140@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1784044424.923368:0:3639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784044424.923389:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b397f9dfb80 x1870705581084416/t0(0) o400->MGC192.168.202.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784044437 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044424.923406:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b1f80 x1870705581086336/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784044440 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044424.923414:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b0700 x1870705581086464/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784044440 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044424.923424:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b1180 x1870705581086592/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784044440 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044424.923452:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b0a80 x1870705581086720/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784044440 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784044424.923460:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784044424.923464:0:3639:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784044424.923465:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1784044424.923760:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:0:1870705581086848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044424.923782:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581084416:0@lo:400:kworker.0 00000100:00100000:1.0:1784044424.923822:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581086336:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1784044424.924571:0:3640:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9b384447b800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:3.0:1784044424.924759:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9b384447b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044424.924766:0:3639:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 505 00000100:00080000:3.0:1784044424.924777:0:3639:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9b384447b800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044424.924809:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503be300 x1870705581087232/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044424.924915:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99a46fb7-9af9-40f1-9c76-329d6781ee81:3637:1870705581087232:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1784044424.924970:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705581087232 offset 0 length 520: 4 00000100:00100000:3.0:1784044424.925018:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581086464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044424.926369:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581086592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044424.926406:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581086720:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1784044424.931604:0:20976:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9b3974da19c0) has no exports 00000020:01000000:3.0:1784044424.981493:0:20976:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b3950e8bd80 - data ffff9b3951b03e58/ffff9b38437f9c00 00000020:01000000:3.0:1784044424.981673:0:20976:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b397b8cfae0 - data ffff9b395d677360/ffff9b397c776800 00000001:00000004:3.0:1784044424.995403:0:20976:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1784044425.033688:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044425.033698:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784044425.033706:0:20976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784044425.036011:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784044425.036018:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1784044425.036035:0:20976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784044425.036038:0:20976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784044425.036384:0:17941:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784044425.036389:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1784044425.036415:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1784044425.036962:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784044425.036966:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1784044425.036979:0:20976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784044425.036980:0:20976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784044425.037267:0:17943:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784044425.037270:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1784044425.037286:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1784044425.037944:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba191de 00000020:00000080:2.0:1784044425.037952:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b397a9e9800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1784044425.038558:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba191f3 00000020:00000080:2.0:1784044425.038565:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b395820c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784044425.038572:0:20976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1784044425.038579:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044425.038589:0:20976:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784044425.038595:0:20976:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9b3843048000) has no exports 00000004:01000000:2.0:1784044425.038751:0:20976:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784044425.038758:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19247 00000020:00000080:2.0:1784044425.038762:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b3842121000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784044425.038766:0:20976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1784044425.038782:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044425.038787:0:20976:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784044425.038789:0:20976:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9b3842454d40) has no exports 00000020:00000080:2.0:1784044425.038794:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19240 00000020:00000080:2.0:1784044425.038798:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b3842449000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1784044425.039138:0:20976:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1784044425.039143:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784044425.039147:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1784044425.039155:0:20976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784044425.039158:0:20976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784044425.039212:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044425.039218:0:20976:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784044425.039222:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19232 00000020:00000080:2.0:1784044425.039226:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b3842127000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784044425.039229:0:20976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1784044425.039233:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044425.039236:0:20976:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784044425.039238:0:20976:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9b3974254d40) has no exports 00000020:00000080:2.0:1784044425.039243:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19224 00000020:00000080:2.0:1784044425.039245:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b3842121800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1784044425.039556:0:20976:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1784044425.039559:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784044425.039562:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1784044425.039565:0:20976:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784044425.039566:0:20976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784044425.039586:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044425.039590:0:20976:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1784044425.039600:0:20976:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1784044425.039604:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19216 00000020:00000080:2.0:1784044425.039608:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b3842122000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784044425.039612:0:20976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1784044425.039615:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044425.039623:0:20976:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784044425.039626:0:20976:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9b39742519c0) has no exports 00000020:00000080:2.0:1784044425.039629:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1920f 00000020:00000080:2.0:1784044425.039632:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b3970ff2800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784044425.040862:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397a9e9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784044425.040881:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b395820c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1784044425.040885:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842121000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1784044425.040898:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842449000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784044425.040902:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3944fd3800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1784044425.040920:0:37:0:(genops.c:906:class_export_put()) final put ffff9b3842126800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784044425.040922:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842126800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1784044425.040926:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784044425.041005:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842127000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1784044425.041011:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842121800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784044425.041015:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3970ff4800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1784044425.041018:0:37:0:(genops.c:906:class_export_put()) final put ffff9b3842120800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784044425.041020:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842120800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1784044425.041023:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784044425.041048:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842122000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1784044425.041054:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3970ff2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1784044425.056289:0:20976:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1784044425.056298:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044425.056302:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784044425.056310:0:20976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784044425.056368:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044425.056390:0:20976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784044425.056420:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044425.056423:0:20976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784044425.056429:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b397a9ef800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784044425.056434:0:20976:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397a9ef800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1784044425.056446:0:20976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784044425.056608:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba191fa 00000020:00000080:0.0:1784044425.056615:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b395820c800/lustre-MDD0001_UUID 00000020:01000000:0.0:1784044425.056620:0:20976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1784044425.056624:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044425.056629:0:20976:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784044425.056632:0:20976:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9b3974da3380) has no exports 00000020:00000080:0.0:1784044425.056669:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044425.056673:0:20976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1784044425.056676:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19201 00000020:00000080:0.0:1784044425.056680:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b395820a000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1784044425.056687:0:20976:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b396f25a800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1784044425.056691:0:20976:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b396f25a800 2 00000020:01000004:0.0:1784044425.056694:0:20976:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b396f25a800 from lustre-MDT0001 00000020:00000080:0.0:1784044425.056710:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044425.056712:0:20976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1784044425.056714:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b397a9ec800/lustre-MDT0001_UUID 00000020:00000080:0.0:1784044425.056716:0:20976:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397a9ec800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1784044425.056724:0:20976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1784044425.056753:0:20976:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1784044425.056757:0:20976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1784044425.056759:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044425.056762:0:20976:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784044425.056769:0:20976:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9b397b775000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784044425.056774:0:20976:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9b3947bc99c0) has exports, disconnecting them 00000020:00080000:0.0:1784044425.056779:0:20976:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9b397b775000), last request at 1784044328 00000020:00000080:0.0:1784044425.056782:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1927f 00000020:00080000:0.0:1784044425.056795:0:20976:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b397b775000): rc 0 00000020:00000080:0.0:1784044425.056798:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b397b775000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1784044425.057573:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3970ff5000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1784044425.057584:0:37:0:(genops.c:906:class_export_put()) final put ffff9b3970ff5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784044425.057587:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3970ff5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1784044425.057600:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784044425.057717:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b395820c800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1784044425.057722:0:37:0:(genops.c:906:class_export_put()) final put ffff9b397a9ee800/lustre-MDD0001_UUID 00000020:00000080:1.0:1784044425.057724:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397a9ee800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1784044425.057728:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1784044425.057853:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b395820a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784044425.057858:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b775000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1784044425.080450:0:20976:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1784044425.080459:0:20976:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044425.080463:0:20976:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784044425.080472:0:20976:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784044425.080676:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044425.080685:0:20976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1784044425.080691:0:20976:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b396f25a800 1 00000020:00000080:0.0:1784044425.080697:0:20976:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba191a6 00000020:00000080:0.0:1784044425.080706:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b3974dae000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784044425.080944:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3974dae800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1784044425.080951:0:37:0:(genops.c:906:class_export_put()) final put ffff9b397b776000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1784044425.080954:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b776000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1784044425.080965:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:0.0:1784044425.081139:0:20976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1784044425.081144:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044425.081148:0:20976:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784044425.081152:0:20976:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9b384304cd40) has no exports 00000020:00000080:1.0:1784044425.087625:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974dae000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784044425.102134:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044425.102148:0:20976:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1784044425.102155:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b396f259000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784044425.102159:0:20976:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f259000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1784044425.102294:0:20976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1784044425.102441:0:20976:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b396f25a000 00000020:01000000:1.0:1784044425.102464:0:20976:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1784044425.102469:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044425.102474:0:20976:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784044425.102478:0:20976:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9b3843564d40) has no exports 00000100:00100000:0.0:1784044425.102801:0:17200:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b3965db1000:17200] 1 exiting: rc = 0 00000100:00100000:0.0:1784044425.102909:0:18572:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b39484d7400:18572] 3 exiting: rc = 0 00000100:00100000:2.0:1784044425.103308:0:19739:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9b3843f47200:19739] 4 exiting: rc = 0 00000100:00100000:2.0:1784044425.103439:0:17201:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b3974127200:17201] 2 exiting: rc = 0 00000100:00100000:2.0:1784044425.103532:0:17199:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b397b77ec00:17199] 0 exiting: rc = 1 00000100:00100000:1.0:1784044425.103829:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103837:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103844:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103851:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103857:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103864:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103870:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103876:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103897:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103904:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103910:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103917:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103923:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103930:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103936:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103942:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103947:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103954:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103960:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103967:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103972:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103979:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103986:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103994:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.103999:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104005:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104010:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104016:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104022:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104028:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104033:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104039:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104045:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104051:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104057:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104062:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104068:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104074:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104080:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104086:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104092:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104098:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104103:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104279:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104286:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104292:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104299:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104304:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104310:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104315:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104320:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104326:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104330:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104337:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104342:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104348:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104353:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104358:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104363:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104368:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104374:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104388:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104395:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.104401:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044425.108771:0:17203:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b397420d600:17203] 1 exiting: rc = 0 00000100:00100000:2.0:1784044425.108954:0:17202:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b3844768400:17202] 0 exiting: rc = 1 00000100:00100000:1.0:1784044425.109053:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109062:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109068:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109074:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109078:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109083:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109088:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109093:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109098:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109102:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109108:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109113:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109129:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109133:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109153:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109158:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109163:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109168:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109203:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109210:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109217:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109224:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109229:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109234:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109240:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109245:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109250:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109255:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109261:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109267:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109273:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109279:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109284:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109289:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109295:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109300:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109305:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109311:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109317:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109323:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109329:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109335:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109341:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109347:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109353:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109358:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109364:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109369:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109384:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109399:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109405:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109411:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109416:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109422:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109427:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109433:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109438:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109444:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109450:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109457:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109463:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109469:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109474:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.109480:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044425.110317:0:17206:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b397a8d1e00:17206] 1 exiting: rc = 0 00000100:00100000:2.0:1784044425.110470:0:17205:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b397a8d1600:17205] 0 exiting: rc = 1 00000100:00100000:1.0:1784044425.110616:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110623:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110629:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110635:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110641:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110648:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110653:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110659:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110677:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110685:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110692:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110698:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110704:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110712:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110720:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110727:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110735:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110743:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110751:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110757:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110789:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110797:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110803:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110809:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110815:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110822:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110828:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110835:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110844:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110850:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110856:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110864:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110887:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110896:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110902:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110909:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110915:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110922:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110928:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110934:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110940:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110946:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110952:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110958:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110976:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110983:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110989:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.110995:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111000:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111006:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111012:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111018:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111023:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111030:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111035:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111046:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111063:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111069:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111074:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111079:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111086:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111093:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111099:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.111106:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044425.120867:0:17207:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b397a8d0e00:17207] 0 exiting: rc = 1 00000100:00100000:2.0:1784044425.120978:0:17208:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b397a8d1800:17208] 1 exiting: rc = 0 00000100:00100000:1.0:1784044425.121062:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121069:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121074:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121079:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121084:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121090:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121095:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121100:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121104:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121109:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121122:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121128:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121133:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121138:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121143:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121148:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121152:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121158:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121162:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121167:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121194:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121200:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121205:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121210:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121215:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121220:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121237:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121242:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121246:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121250:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121255:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121259:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121264:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121270:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121275:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121281:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121287:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121291:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121296:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121302:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121307:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121312:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121317:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121321:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121326:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121330:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121336:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121341:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121345:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121350:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121354:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121358:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121363:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121368:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121373:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121387:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121393:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121398:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121403:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121407:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121412:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121426:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121430:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.121435:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.121939:0:17210:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b397a8d0600:17210] 1 exiting: rc = 0 00000100:00100000:0.0:1784044425.122072:0:17209:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b397a8d0c00:17209] 0 exiting: rc = 1 00000100:00100000:1.0:1784044425.122154:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122161:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122166:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122201:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122208:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122213:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122219:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122226:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122231:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122237:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122243:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122247:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122253:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122259:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122265:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122270:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122276:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122281:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122286:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122292:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122297:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122302:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122307:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122312:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122316:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122321:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122326:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122331:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122335:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122341:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122345:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122350:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122365:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122371:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122385:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122391:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122395:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122400:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122405:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122410:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122415:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122419:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122424:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122428:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122432:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122437:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122441:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122446:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122450:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122454:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122458:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122463:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122468:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122474:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122478:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122482:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122488:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122492:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122670:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122678:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122683:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122688:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122693:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.122698:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.123510:0:17211:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b397a8d1a00:17211] 0 exiting: rc = 1 00000100:00100000:2.0:1784044425.124666:0:17212:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b397a8d0200:17212] 1 exiting: rc = 0 00000100:00100000:1.0:1784044425.124801:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124808:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124826:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124830:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124838:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124843:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124849:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124854:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124859:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124864:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124871:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124877:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124882:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124888:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124892:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124897:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124902:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124907:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124912:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124916:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124921:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124926:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124932:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124936:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124943:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124948:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124954:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124959:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124963:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124968:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124973:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124977:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124982:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124988:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124994:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.124999:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125004:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125016:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125021:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125027:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125033:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125038:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125043:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125048:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125052:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125057:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125062:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125066:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125070:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125074:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125079:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125083:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125087:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125092:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125096:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125101:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125106:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125111:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125126:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125132:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125138:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125143:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125148:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125153:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044425.125804:0:17215:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b397591c200:17215] 2 exiting: rc = 0 00000100:00100000:2.0:1784044425.126131:0:17213:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b38426dd000:17213] 0 exiting: rc = 1 00000100:00100000:1.0:1784044425.126489:0:17214:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b38426dd600:17214] 1 exiting: rc = 0 00000100:00100000:2.0:1784044425.126657:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126667:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126674:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126688:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126696:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126702:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126708:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126714:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126719:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126726:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126731:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126738:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126758:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126766:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126772:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126777:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126783:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126789:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126795:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126800:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126819:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126825:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126831:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126837:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126846:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126851:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126857:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126865:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126872:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126878:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126884:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126889:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126894:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126901:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126906:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126912:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126935:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126943:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126948:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126954:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126960:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126966:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126971:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126977:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126983:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126988:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126994:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.126999:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127005:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127011:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127018:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127023:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127029:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127037:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127042:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127053:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127059:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127065:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127070:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127076:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127082:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127088:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127093:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044425.127107:0:20976:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1784044425.132025:0:20976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044425.132046:0:20976:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1784044425.132055:0:20976:0:(genops.c:906:class_export_put()) final put ffff9b397ab0a000/MDS_uuid 00000020:00000080:2.0:1784044425.132059:0:20976:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397ab0a000/MDS_uuid for MDS 00000020:01000000:2.0:1784044425.132066:0:20976:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1784044425.132561:0:20976:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1784044425.233302:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044426.253312:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784044426.320651:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044426.320664:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044426.320667:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044426.320672:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784044426.320685:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b38423e1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044426.320695:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 614 00000100:00080000:1.0:1784044426.320703:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784044426.320713:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b38423e1800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044426.320760:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b384316f100 x1870705581087360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044426.320802:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044426.320806:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784044426.320808:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b39513bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044426.320811:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 614 00000100:00080000:1.0:1784044426.320814:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784044426.320818:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b39513bb000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044426.320902:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b384316d500 x1870705581087616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784044426.320954:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581087360:0@lo:38:kworker.0 00000400:00000100:1.0:1784044426.321012:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581087360 offset 0 length 520: 4 00000100:00100000:1.0:1784044426.321042:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581087616:0@lo:38:kworker.0 00000400:00000100:1.0:1784044426.321058:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581087616 offset 0 length 520: 4 00000100:00100000:1.0:1784044426.321091:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581087488:0@lo:400:kworker.0 00000400:00000100:1.0:1784044426.322706:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581087488 offset 0 length 224: 4 00000100:00100000:1.0:1784044426.322766:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581087744:0@lo:400:kworker.0 00000400:00000100:1.0:1784044426.322793:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581087744 offset 0 length 224: 4 00010000:00010000:0.0:1784044427.277462:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044428.301326:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784044428.768987:0:21178:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784044428.786782:0:21178:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1784044428.786833:0:21178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044428.786848:0:21178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044428.786855:0:21178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044428.786862:0:21178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044428.786889:0:21178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784044428.786895:0:21178:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1784044428.786913:0:20228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044428.786919:0:20228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044428.786927:0:20228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044428.786930:0:20228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784044428.786931:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1784044428.786938:0:20228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044428.786942:0:21178:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b384316f100 x1870705581087360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784044441 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:2.0:1784044428.786945:0:20228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044428.786951:0:20228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784044428.786953:0:20228:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784044428.786963:0:20228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784044428.786978:0:20228:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b384447b800 00010000:00010000:2.0:1784044428.786982:0:20228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044428.786982:0:21178:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784044428.786987:0:21178:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1784044428.786988:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784044428.786993:0:21178:0:(import.c:65:import_set_state_nolock()) ffff9b38423e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1784044428.786996:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1784044428.786998:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044428.786999:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044428.787000:0:21178:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b384316f100 x1870705581087360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784044441 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784044428.787001:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044428.787007:0:21178:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784044428.787010:0:21178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1784044428.787083:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581087360:0@lo:38:kworker.0 00000100:00080000:0.0:1784044428.789083:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784044428.789097:0:21178:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b384316c700 x1870705581087488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044442 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044428.789123:0:21178:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784044428.789128:0:21178:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784044428.789152:0:21178:0:(import.c:65:import_set_state_nolock()) ffff9b384242f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784044428.789254:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1870705581087872:0@lo:39:umount.0 00000400:00000100:3.0:1784044428.789310:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581087872 offset 0 length 224: 4 00000100:00100000:1.0:1784044428.789695:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581087488:0@lo:400:kworker.0 00010000:00010000:2.0:1784044429.325422:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044430.349395:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784044430.349548:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044430.349554:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044430.349557:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044430.349560:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044430.349849:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581088000:0@lo:400:kworker.0 00000400:00000100:2.0:1784044430.350100:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581088000 offset 0 length 224: 4 00000001:00100000:1.0:1784044430.927015:0:18702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784044430.927024:0:18702:0:(genops.c:906:class_export_put()) final put ffff9b3842443800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784044430.927414:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842443800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000001:00100000:3.0:1784044430.928348:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784044430.928354:0:19522:0:(genops.c:906:class_export_put()) final put ffff9b3947bbe000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784044430.928914:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3842441000 for lustre-OST0000 00000020:00000080:2.0:1784044430.929311:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3947bbe000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784044430.929428:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3947bba800 for lustre-OST0001 00000100:00080000:2.0:1784044431.374576:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784044431.374590:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784044431.374593:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784044431.374596:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784044431.374818:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044431.374840:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581088128:0@lo:400:kworker.0 00000400:00000100:3.0:1784044431.374910:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581088128 offset 0 length 224: 4 00010000:00010000:0.0:1784044431.381856:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044432.398565:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044433.422310:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044434.445482:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044434.957367:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044424/real 1784044424] req@ffff9b39503be300 x1870705581087232/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784044434 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044434.957421:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b39503be300 x1870705581087232/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784044434 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784044434.957451:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b384447b800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044434.957474:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1784044434.957479:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99a46fb7-9af9-40f1-9c76-329d6781ee81:3637:1870705581087232:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1784044434.957615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044434.957620:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1784044434.957623:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b384447b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044434.957628:0:36:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 618 00000100:00080000:0.0:1784044434.957633:0:36:0:(import.c:589:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784044434.957640:0:36:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9b384447b800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044434.957672:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b1180 x1870705581088256/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044434.957710:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044434.957714:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784044434.957822:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99a46fb7-9af9-40f1-9c76-329d6781ee81:3637:1870705581088256:0@lo:250:kworker.0 00000100:00100000:1.0:1784044434.957822:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044434.957837:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581088384:0@lo:400:kworker.0 00000400:00000100:3.0:1784044434.957877:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705581088256 offset 0 length 520: 4 00000400:00000100:1.0:1784044434.957878:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581088384 offset 0 length 224: 4 00010000:00010000:0.0:1784044435.469539:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044436.496302:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044437.517457:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044438.029316:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044428/real 1784044428] req@ffff9b39503b0a80 x1870705581087872/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044438 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044438.029348:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b39503b0a80 x1870705581087872/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044438 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784044438.029367:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b384242f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784044438.029388:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1870705581087872:0@lo:39:umount.0 00000100:00080000:0.0:1784044438.029426:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784044438.029430:0:21178:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784044438.029435:0:21178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784044438.030400:0:21178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044438.030414:0:21178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044438.030422:0:21178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044438.030428:0:21178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044438.030452:0:21178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044438.030458:0:21178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044438.030465:0:21178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044438.030471:0:21178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044438.030493:0:21178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044438.030510:0:21178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1784044438.030514:0:21178:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1784044438.030535:0:21178:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1784044438.030539:0:21178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1784044438.030543:0:21178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044438.030548:0:21178:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784044438.030552:0:21178:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9b3974da4d40) has no exports 00000020:00080000:0.0:1784044438.030574:0:21178:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9b3974da4d40) has no exports 00010000:00010000:1.0:1784044438.032554:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044438.032568:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044438.032580:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044438.032584:0:19100:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044438.032594:0:19100:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044438.032601:0:19100:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044438.032608:0:19100:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784044438.032611:0:19100:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1784044438.032633:0:19100:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1784044438.032656:0:19100:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b384447b800 00010000:00010000:1.0:1784044438.032660:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044438.032667:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044438.032685:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044438.032689:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044438.032695:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044438.032697:0:19100:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044438.032703:0:19100:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044438.032709:0:19100:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044438.032714:0:19100:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784044438.032716:0:19100:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784044438.032718:0:19100:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784044438.032723:0:19100:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b384447b800 00010000:00010000:1.0:1784044438.032725:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044438.032731:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044438.032750:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044438.032752:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044438.032754:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044438.033316:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1784044438.035799:0:21178:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b397421d300 - data ffff9b395d430948/ffff9b397cb36000 00000020:01000000:0.0:1784044438.035972:0:21178:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b3843334540 - data ffff9b395168d1b0/ffff9b3948428c00 00100000:10000000:0.0:1784044438.045122:0:21178:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1784044438.053034:0:21178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19304 00000020:00000080:1.0:1784044438.053047:0:21178:0:(genops.c:906:class_export_put()) final put ffff9b397a9ea800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1784044438.053300:0:21178:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3843fd5000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1784044438.053305:0:21178:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3843fd5000 2 00000020:01000004:1.0:1784044438.053308:0:21178:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b3843fd5000 from lustre-OST0000 00000020:00000080:1.0:1784044438.053331:0:21178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044438.053340:0:21178:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1784044438.053344:0:21178:0:(genops.c:906:class_export_put()) final put ffff9b397418e800/lustre-OST0000_UUID 00000020:00000080:1.0:1784044438.053347:0:21178:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397418e800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1784044438.053353:0:21178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1784044438.053415:0:21178:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1784044438.053430:0:21178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1784044438.053434:0:21178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044438.053439:0:21178:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784044438.053445:0:21178:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b38423e4800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784044438.053451:0:21178:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff9b3842110000) has exports, disconnecting them 00000020:00080000:1.0:1784044438.053456:0:21178:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b38423e4800), last request at 1784044347 00000020:00000080:1.0:1784044438.053460:0:21178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1932e 00000020:00080000:1.0:1784044438.053470:0:21178:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b38423e4800): rc 0 00000020:00000080:1.0:1784044438.053475:0:21178:0:(genops.c:906:class_export_put()) final put ffff9b38423e4800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1784044438.056268:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397a9ea800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1784044438.057127:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b38423e4800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1784044438.059704:0:21178:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1784044438.059722:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784044438.059726:0:21178:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784044438.059734:0:21178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784044438.059892:0:21178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044438.059901:0:21178:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1784044438.059909:0:21178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784044438.059913:0:21178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044438.059918:0:21178:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784044438.059925:0:21178:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9b384242f000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784044438.059932:0:21178:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff9b39459bb380) has exports, disconnecting them 00000020:00080000:2.0:1784044438.059936:0:21178:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9b384242f000), last request at 1784044347 00000020:00000080:2.0:1784044438.059942:0:21178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19343 00000020:00080000:2.0:1784044438.059962:0:21178:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b384242f000): rc 0 00000020:00000080:2.0:1784044438.059968:0:21178:0:(genops.c:906:class_export_put()) final put ffff9b384242f000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1784044438.060140:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b38423e1800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1784044438.060151:0:36:0:(genops.c:906:class_export_put()) final put ffff9b38423e0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1784044438.060154:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b38423e0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1784044438.060164:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1784044438.060244:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384242f000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1784044438.063219:0:21178:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1784044438.063228:0:21178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784044438.063233:0:21178:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784044438.063240:0:21178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784044438.063291:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b384242f800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1784044438.063445:0:21178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044438.063454:0:21178:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1784044438.063458:0:21178:0:(genops.c:906:class_export_put()) final put ffff9b3842429000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1784044438.063461:0:21178:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842429000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1784044438.063467:0:21178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1784044438.063533:0:21178:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3843fd5000 1 00000020:00000080:3.0:1784044438.063539:0:21178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba192e1 00000020:00000080:3.0:1784044438.063545:0:21178:0:(genops.c:906:class_export_put()) final put ffff9b3958209800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1784044438.063553:0:21178:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1784044438.063561:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3958209800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1784044438.063570:0:21178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044438.063574:0:21178:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784044438.063578:0:21178:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff9b3842114d40) has no exports 00000020:00000080:3.0:1784044438.097678:0:21178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044438.097693:0:21178:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1784044438.097699:0:21178:0:(genops.c:906:class_export_put()) final put ffff9b3843fd1800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1784044438.097705:0:21178:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843fd1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1784044438.097718:0:21178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1784044438.098117:0:21178:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b3843fd0000 00000020:02000400:3.0:1784044438.104104:0:21178:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1784044438.542499:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044439.566612:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044440.142838:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044440.142849:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044440.142852:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044440.142855:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044440.142942:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044440.142960:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581088512:0@lo:400:kworker.0 00000400:00000100:2.0:1784044440.143015:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581088512 offset 0 length 224: 4 00010000:00010000:1.0:1784044440.591920:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044441.102517:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044426/real 1784044426] req@ffff9b384316d500 x1870705581087616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1784044441 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044441.102547:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b384316d500 x1870705581087616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1784044441 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784044441.102577:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39513bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044441.102600:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784044441.102605:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581087616:0@lo:38:kworker.0 00000100:00080000:0.0:1784044441.102680:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044441.102685:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044441.102687:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044441.102690:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784044441.102694:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b39513bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044441.102699:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 619 00000100:00080000:0.0:1784044441.102704:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784044441.102711:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b39513bb000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044441.102744:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b1500 x1870705581088640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044441.102819:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044441.102838:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581088768:0@lo:400:kworker.0 00000400:00000100:0.0:1784044441.102887:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581088768 offset 0 length 224: 4 00000100:00100000:3.0:1784044441.102965:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581088640:0@lo:38:kworker.0 00000400:00000100:3.0:1784044441.102988:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581088640 offset 0 length 520: 4 00010000:00010000:3.0:1784044441.616675:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1784044442.126694:0:3640:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044426/real 1784044426] req@ffff9b384316c000 x1870705581087744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044442 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:01000004:0.0:1784044442.147083:0:21380:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000100:00100000:1.0:1784044442.163956:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9b384316c000 x1870705581087744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044442 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784044442.164109:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b397a9eb000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784044442.164113:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784044442.191390:0:3640:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1784044442.191477:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044442.191484:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044442.191487:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044442.191500:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044442.191502:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044442.191506:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784044442.191510:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b397a9eb000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044442.191518:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 562 00000100:00080000:0.0:1784044442.191528:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b397a9eb000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044442.191570:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b2a00 x1870705581088896/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044442.191624:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581087744:0@lo:400:kworker.0 00000100:00100000:1.0:1784044442.192332:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1870705581088896:0@lo:38:kworker.0 00000400:00000100:1.0:1784044442.192385:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581088896 offset 0 length 520: 4 00000020:01000004:0.0:1784044442.196566:0:21380:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1784044442.196656:0:21380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044442.196673:0:21380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044442.196682:0:21380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044442.196689:0:21380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044442.196727:0:21380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784044442.196733:0:21380:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784044442.196756:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044442.196767:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b1500 x1870705581088640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784044461 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.196784:0:21380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784044442.196788:0:21380:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784044442.196793:0:21380:0:(import.c:65:import_set_state_nolock()) ffff9b39513bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1784044442.196797:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044442.196799:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b1500 x1870705581088640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784044461 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.196804:0:21380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784044442.196806:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:2.0:1784044442.196844:0:20228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044442.196850:0:20228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044442.196856:0:20228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982054e00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044442.196858:0:20228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044442.196865:0:20228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044442.196881:0:20228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044442.196887:0:20228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784044442.196890:0:20228:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784044442.196892:0:20228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784044442.196906:0:20228:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b384447b800 00010000:00010000:2.0:1784044442.196911:0:20228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044442.196918:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044442.196930:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044442.196931:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044442.196933:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044442.197002:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581088640:0@lo:38:kworker.0 00000100:00080000:0.0:1784044442.198427:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784044442.198441:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b384316c700 x1870705581088000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044446 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.198508:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843d4f480 x1870705581088128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044447 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.198530:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b3100 x1870705581088384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044450 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.198544:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503be300 x1870705581088512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044456 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.198553:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b1c00 x1870705581088768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044457 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.198568:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b2a00 x1870705581088896/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784044452 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.198597:0:21380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784044442.198602:0:21380:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784044442.198608:0:21380:0:(import.c:65:import_set_state_nolock()) ffff9b397a9eb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1784044442.198613:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784044442.198616:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b384316c700 x1870705581088000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044446 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044442.198671:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581088384:0@lo:400:kworker.0 00000100:00100000:3.0:1784044442.198711:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581088128:0@lo:400:kworker.0 00000100:00100000:2.0:1784044442.198753:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581088000:0@lo:400:kworker.0 00000100:00100000:0.0:1784044442.198774:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843d4f480 x1870705581088128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044447 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.198783:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b3100 x1870705581088384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044450 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.198791:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503be300 x1870705581088512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044456 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.198798:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b1c00 x1870705581088768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044457 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.198806:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b2a00 x1870705581088896/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784044452 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044442.198813:0:21380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784044442.198867:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1870705581088896:0@lo:38:kworker.0 00000100:00100000:2.0:1784044442.198973:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581088512:0@lo:400:kworker.0 00000100:00100000:0.0:1784044442.199095:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1784044442.199117:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581088768:0@lo:400:kworker.0 00010000:00010000:1.0:1784044442.203779:0:21380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044442.203794:0:21380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044442.203803:0:21380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044442.203810:0:21380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044442.203877:0:21380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044442.203886:0:21380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044442.203893:0:21380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044442.203912:0:21380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044442.203919:0:21380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044442.204652:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044442.204661:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044442.204670:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798a00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044442.204674:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044442.204683:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044442.204691:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044442.204698:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784044442.204700:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1784044442.204712:0:17188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b384447b800 00010000:00010000:3.0:1784044442.204716:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044442.204736:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044442.204748:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044442.204752:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044442.204758:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044442.204761:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044442.204767:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044442.204773:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044442.204778:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784044442.204781:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1784044442.204784:0:17188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b384447b800 00010000:00010000:3.0:1784044442.204787:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044442.204793:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044442.204795:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044442.204797:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044442.204873:0:21380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784044442.204879:0:21380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044442.204894:0:21380:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1784044442.204898:0:21380:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1784044442.204900:0:21380:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1784044442.204928:0:21380:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1784044442.204932:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1784044442.204939:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044442.204944:0:21380:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784044442.204947:0:21380:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9b3947bc8000) has no exports 00000020:00080000:1.0:1784044442.204986:0:21380:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9b3947bc8000) has no exports 00000020:01000000:1.0:1784044442.207505:0:21380:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b397421dc00 - data ffff9b3951af9a20/ffff9b39749f3800 00000020:01000000:1.0:1784044442.207660:0:21380:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b397421dae0 - data ffff9b3951a7ea20/ffff9b38431bd400 00010000:00010000:0.0:1784044442.208332:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1784044442.212331:0:21380:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1784044442.219796:0:21380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19462 00000020:00000080:3.0:1784044442.219809:0:21380:0:(genops.c:906:class_export_put()) final put ffff9b38437d9000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1784044442.219862:0:21380:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3975aa7800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1784044442.219876:0:21380:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3975aa7800 2 00000020:01000004:3.0:1784044442.219880:0:21380:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b3975aa7800 from lustre-OST0001 00000020:00000080:3.0:1784044442.219902:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044442.219911:0:21380:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1784044442.219915:0:21380:0:(genops.c:906:class_export_put()) final put ffff9b38437da800/lustre-OST0001_UUID 00000020:00000080:3.0:1784044442.219918:0:21380:0:(genops.c:865:class_export_destroy()) destroying export ffff9b38437da800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1784044442.219925:0:21380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1784044442.220034:0:21380:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS 00010000:00010000:3.0:1784044442.220051:0:21380:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba191ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba191b4 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044442.220065:0:21380:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba191ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba191b4 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044442.220071:0:21380:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1784044442.220073:0:21380:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1784044442.220077:0:21380:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1784044442.220091:0:21380:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b384447b800 00010000:00010000:3.0:1784044442.220094:0:21380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba191ad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba191b4 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044442.220111:0:21380:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044442.220117:0:21380:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044442.220122:0:21380:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784044442.220124:0:21380:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1784044442.220126:0:21380:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1784044442.220136:0:21380:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b384447b800 00010000:00010000:3.0:1784044442.220138:0:21380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784044442.220162:0:21380:0:(import.c:65:import_set_state_nolock()) ffff9b384447b800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1784044442.220166:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784044442.220168:0:21380:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784044442.220170:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784044442.220198:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784044442.220211:0:21380:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b39503b1180 x1870705581088256/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784044449 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784044442.220235:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784044442.220238:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:1.0:1784044442.220504:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b38437d9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1784044442.220541:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99a46fb7-9af9-40f1-9c76-329d6781ee81:3637:1870705581088256:0@lo:250:kworker.0 10000000:01000000:3.0:1784044442.220601:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1784044442.220608:0:21380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19087 00000020:00000080:3.0:1784044442.220613:0:21380:0:(genops.c:906:class_export_put()) final put ffff9b397ab0c000/99a46fb7-9af9-40f1-9c76-329d6781ee81 00000020:01000000:3.0:1784044442.220652:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.140@tcp (flags='') 00000020:00000080:3.0:1784044442.220658:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044442.220663:0:21380:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.140@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784044442.220666:0:21380:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9b3842450000) has no exports 10000000:01000000:0.0:1784044442.220724:0:17196:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1784044442.220800:0:21380:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.140@tcp: client import never connected 00000100:00080000:3.0:1784044442.220803:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1784044442.220805:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784044442.220807:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1784044442.220809:0:21380:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1784044442.220944:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397ab0c000/99a46fb7-9af9-40f1-9c76-329d6781ee81 for MGC192.168.202.140@tcp 00000020:00000080:3.0:1784044442.221145:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044442.221151:0:21380:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.140@tcp (uuid 99a46fb7-9af9-40f1-9c76-329d6781ee81) 00000020:01000000:3.0:1784044442.221157:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1784044442.221161:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044442.221164:0:21380:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784044442.221169:0:21380:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b3958209000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784044442.221266:0:21380:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff9b3970fe19c0) has exports, disconnecting them 00000020:00080000:3.0:1784044442.221271:0:21380:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b3958209000), last request at 1784044369 00000020:00000080:3.0:1784044442.221275:0:21380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1948c 00000020:00080000:3.0:1784044442.221289:0:21380:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3958209000): rc 0 00000020:00000080:3.0:1784044442.221293:0:21380:0:(genops.c:906:class_export_put()) final put ffff9b3958209000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1784044442.221458:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b384447b800 for MGC192.168.202.140@tcp 00000020:00000080:1.0:1784044442.221465:0:36:0:(genops.c:906:class_export_put()) final put ffff9b384447c000/99a46fb7-9af9-40f1-9c76-329d6781ee81 00000020:00000080:1.0:1784044442.221468:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384447c000/99a46fb7-9af9-40f1-9c76-329d6781ee81 for MGC192.168.202.140@tcp 00000020:01000000:1.0:1784044442.221479:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.140@tcp (99a46fb7-9af9-40f1-9c76-329d6781ee81) 00000020:00000080:1.0:1784044442.221887:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3958209000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1784044442.246322:0:21380:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1784044442.246331:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044442.246336:0:21380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784044442.246344:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784044442.246530:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044442.246552:0:21380:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1784044442.246562:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1784044442.246566:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044442.246571:0:21380:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784044442.246578:0:21380:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9b3842444000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784044442.246585:0:21380:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9b3970fe4d40) has exports, disconnecting them 00000020:00080000:0.0:1784044442.246590:0:21380:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9b3842444000), last request at 1784044369 00000020:00000080:0.0:1784044442.246595:0:21380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba194a1 00000020:00080000:0.0:1784044442.246612:0:21380:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3842444000): rc 0 00000020:00000080:0.0:1784044442.246619:0:21380:0:(genops.c:906:class_export_put()) final put ffff9b3842444000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1784044442.247104:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b39513bb000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1784044442.247112:0:36:0:(genops.c:906:class_export_put()) final put ffff9b3842442000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1784044442.247115:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842442000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1784044442.247125:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1784044442.247215:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842444000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1784044442.262240:0:21380:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1784044442.262249:0:21380:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784044442.262253:0:21380:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784044442.262261:0:21380:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784044442.262396:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1784044442.262527:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397a9eb000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1784044442.262606:0:20228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1784044442.262741:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1784044442.262871:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1784044442.263110:0:17182:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b38420ec400:17182] 0 exiting: rc = 1 00000100:00100000:3.0:1784044442.263256:0:17183:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b38420ec800:17183] 1 exiting: rc = 0 00000100:00100000:1.0:1784044442.263361:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044442.263689:0:17186:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b38420edc00:17186] 2 exiting: rc = 0 00000100:00100000:2.0:1784044442.264087:0:20342:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b3974a35e00:20342] 3 exiting: rc = 0 00000100:00100000:1.0:1784044442.265285:0:17184:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b38420ed800:17184] 0 exiting: rc = 1 00000100:00100000:0.0:1784044442.268031:0:17185:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b38420ed600:17185] 1 exiting: rc = 0 00000100:00100000:1.0:1784044442.268217:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268235:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268241:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268247:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268254:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268260:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268265:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268271:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268276:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268281:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268286:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268291:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268296:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268303:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268308:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268312:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268317:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268321:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268341:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268346:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268352:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268357:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268362:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268367:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268372:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268377:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268383:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268388:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268393:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268399:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268404:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268409:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268414:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268422:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268427:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268432:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268436:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268441:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268447:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268452:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268457:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268463:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268468:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268473:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268479:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268483:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268490:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268494:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268498:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268503:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268508:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268513:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268518:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268531:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268536:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268542:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268548:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268554:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268559:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268565:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268570:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268576:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268582:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.268586:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784044442.269647:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044442.269658:0:21380:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1784044442.269665:0:21380:0:(genops.c:906:class_export_put()) final put ffff9b3842447800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1784044442.269670:0:21380:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842447800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1784044442.269679:0:21380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1784044442.269732:0:21380:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3975aa7800 1 00000020:00000080:1.0:1784044442.269737:0:21380:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba19446 00000020:00000080:1.0:1784044442.269743:0:21380:0:(genops.c:906:class_export_put()) final put ffff9b384242b800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1784044442.269792:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1784044442.269797:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044442.269802:0:21380:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784044442.269806:0:21380:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff9b3947bccd40) has no exports 00000020:00000080:3.0:1784044442.271130:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384242b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1784044442.308430:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044442.308442:0:21380:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1784044442.308448:0:21380:0:(genops.c:906:class_export_put()) final put ffff9b3975aa6800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1784044442.308452:0:21380:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3975aa6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1784044442.308459:0:21380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1784044442.308776:0:21380:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b3975aa0800 00000020:01000000:1.0:1784044442.308794:0:21380:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1784044442.308798:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044442.308802:0:21380:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784044442.308805:0:21380:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9b3974da0000) has no exports 00000020:00000080:1.0:1784044442.308832:0:21380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044442.308837:0:21380:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1784044442.308839:0:21380:0:(genops.c:906:class_export_put()) final put ffff9b395820d000/OSS_uuid 00000020:00000080:1.0:1784044442.308842:0:21380:0:(genops.c:865:class_export_destroy()) destroying export ffff9b395820d000/OSS_uuid for OSS 00000020:01000000:1.0:1784044442.308845:0:21380:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1784044442.308998:0:18708:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b3948471000:18708] 2 exiting: rc = 0 00000100:00100000:2.0:1784044442.309133:0:18706:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b3947bf9a00:18706] 0 exiting: rc = 1 00000100:00080000:0.0:1784044442.309249:0:17195:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1784044442.309337:0:18707:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b39484f3400:18707] 1 exiting: rc = 0 00000100:00100000:0.0:1784044442.309379:0:18933:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b39484d7600:18933] 3 exiting: rc = 0 00000100:00100000:1.0:1784044442.309449:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309458:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309464:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309469:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309474:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309479:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309483:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309488:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309493:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309498:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309503:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309508:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309514:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309519:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309524:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309530:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309536:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309541:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309546:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309550:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309556:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309562:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309567:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309572:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309578:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309584:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309589:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309594:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309602:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309608:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309675:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309682:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309687:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309692:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309697:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309703:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309708:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309714:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309720:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309726:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309731:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309738:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309744:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309750:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309755:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309760:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309766:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309771:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309776:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309781:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309786:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309790:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309795:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309800:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309805:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309810:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309814:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309820:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309824:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309829:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309834:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309839:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309844:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.309849:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044442.313416:0:18710:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b3947b18400:18710] 1 exiting: rc = 0 00000100:00100000:3.0:1784044442.313517:0:20400:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9b39749bc800:20400] 2 exiting: rc = 0 00000100:00100000:2.0:1784044442.313539:0:18709:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b3947b19c00:18709] 0 exiting: rc = 1 00000100:00100000:1.0:1784044442.313660:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313682:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313687:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313693:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313699:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313704:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313709:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313714:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313720:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313726:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313730:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313735:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313741:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313746:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313751:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313756:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313761:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313766:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313771:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313775:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313780:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313785:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313789:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313794:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313799:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313803:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313808:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313812:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313818:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313823:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313827:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313832:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313837:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313843:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313847:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313852:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313865:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313870:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313875:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313880:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313886:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313891:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313896:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313901:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313905:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313910:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313914:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313919:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313924:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313929:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313933:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313938:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313943:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313948:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313953:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313958:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.313963:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.314170:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.314210:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.314215:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.314231:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.314237:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.314241:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.314246:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044442.318965:0:18711:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b397aa41800:18711] 0 exiting: rc = 1 00000100:00100000:2.0:1784044442.319208:0:20343:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9b394847b200:20343] 3 exiting: rc = 0 00000100:00100000:3.0:1784044442.319272:0:18713:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b397cb50e00:18713] 2 exiting: rc = 0 00000100:00100000:0.0:1784044442.319623:0:18712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b397cb50800:18712] 1 exiting: rc = 0 00000100:00100000:2.0:1784044442.320288:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320304:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320310:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320316:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320338:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320344:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320350:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320356:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320362:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320368:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320518:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320525:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320531:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320537:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320544:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320549:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320554:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320560:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320579:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320585:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320590:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320596:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320601:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320607:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320612:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320618:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320624:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320630:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320636:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320641:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320646:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320651:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320656:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320662:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320666:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320671:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320676:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320681:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320686:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320699:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320705:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320710:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320730:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320735:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320740:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320745:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320751:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320756:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320761:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320767:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320773:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320778:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320785:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320791:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320796:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320801:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320807:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320813:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320818:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320822:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320835:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320843:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320856:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.320863:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.331100:0:18714:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b397cb50200:18714] 0 exiting: rc = 1 00000100:00100000:1.0:1784044442.331237:0:18715:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b397cb50c00:18715] 1 exiting: rc = 0 00000100:00100000:2.0:1784044442.331291:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331301:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331306:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331312:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331317:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331323:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331327:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331333:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331337:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331342:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331362:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331368:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331373:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331378:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331382:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331387:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331392:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331398:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331403:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331407:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331412:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331417:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331422:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331427:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331432:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331437:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331441:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331446:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331450:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331455:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331459:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331464:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331468:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331489:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331540:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331546:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331550:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331556:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331561:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331565:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331570:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331576:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331581:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331586:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331590:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331602:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331607:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331612:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331616:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331621:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331627:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331632:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331636:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331641:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331645:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331650:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331655:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331659:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331665:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331670:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331675:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331680:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331684:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.331690:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044442.333622:0:18716:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b38426dce00:18716] 0 exiting: rc = 1 00000100:00100000:3.0:1784044442.333894:0:18717:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b39484e5000:18717] 1 exiting: rc = 0 00000100:00100000:2.0:1784044442.336411:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336419:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336423:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336427:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336448:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336453:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336457:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336460:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336465:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336469:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336473:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336477:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336480:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336484:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336488:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336491:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336518:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336524:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336529:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336534:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336540:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336546:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336552:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336558:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336564:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336570:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336575:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336578:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336591:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336596:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336600:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336603:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336608:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336612:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336629:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336634:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336639:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336645:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336650:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336655:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336669:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336674:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336678:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336681:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336685:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336689:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336693:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336696:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336700:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336704:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336708:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336716:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336728:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336733:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336737:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336740:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336744:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336748:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336751:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336755:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336758:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336762:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336765:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044442.336769:0:21380:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1784044442.342859:0:21380:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1784044463.181278:0:22143:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784044474.656791:0:22743:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784044474.656839:0:22743:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784044474.656840:0:22743:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784044474.656963:0:22743:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b38431d5800 00000020:01000004:2.0:1784044474.656982:0:22743:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784044474.656990:0:22743:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784044474.657005:0:22743:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b3947bcb380) 00000020:00000080:2.0:1784044474.657020:0:22743:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784044474.765279:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784044474.775465:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784044474.788405:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1784044474.788954:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1784044474.789873:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784044474.794717:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784044474.796539:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784044474.799253:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784044474.803881:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784044474.804488:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784044474.805024:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784044474.806082:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1784044474.807915:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784044474.808441:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1784044474.813743:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1784044474.817370:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784044474.819626:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784044474.820844:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1784044474.821866:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1784044474.823018:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1784044474.824247:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1784044474.824848:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1784044474.825545:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784044474.826054:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784044474.826559:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784044474.827525:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1784044474.828101:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784044474.835472:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1784044474.840422:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784044474.841066:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784044474.842409:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784044474.843863:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784044474.845906:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1784044474.847996:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784044474.849616:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1784044474.850012:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784044474.850386:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1784044474.851878:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1784044474.855103:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784044474.859881:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1784044474.860536:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784044474.861267:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784044474.862007:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784044474.862312:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784044474.862731:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784044474.863030:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784044474.867816:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1784044474.869083:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1784044474.869748:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1784044474.870008:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1784044474.870565:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1784044474.870959:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1784044474.871320:0:22743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1784044474.872592:0:22743:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784044474.872866:0:22743:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784044474.872874:0:22743:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784044474.872886:0:22743:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba198fa 00000020:01000004:3.0:1784044474.872894:0:22743:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1784044474.872900:0:22743:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784044474.872905:0:22743:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b38431d5800 from MGS 00000020:01000004:3.0:1784044474.872909:0:22743:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784044474.872919:0:22743:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b39459bb380) 00000020:00000080:3.0:1784044474.872941:0:22743:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784044474.873008:0:22743:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b38431d5800 from MGS, refs=2 00080000:01000000:3.0:1784044474.873013:0:22743:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784044474.873018:0:22743:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba19908 00000100:00100000:3.0:1784044474.873114:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784044474.873281:0:22743:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784044474.873287:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1784044474.874078:0:22743:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1784044474.874086:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1784044474.875125:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044474.875509:0:22743:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1784044474.875516:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1784044474.876886:0:22743:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1784044474.876897:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1784044474.877552:0:22743:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1784044474.877560:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1784044474.878882:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044474.878887:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044474.878896:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044474.879197:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044474.879200:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044474.879202:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044474.880903:0:22743:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1784044474.886049:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1784044474.887164:0:22743:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1784044474.888092:0:22755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784044474.888115:0:22743:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784044474.888154:0:22743:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784044474.889278:0:22743:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784044474.889954:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784044474.890107:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784044474.890113:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784044474.898465:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784044474.898479:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784044474.899029:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784044474.899036:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1784044474.900366:0:22760:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1784044474.900512:0:22743:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784044474.900536:0:22743:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.140@tcp' 00000020:01000004:1.0:1784044474.900538:0:22743:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1784044474.900571:0:22743:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.140@tcp (typ=mgc) 00000020:00000080:1.0:1784044474.900585:0:22743:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.140@tcp (ffff9b3970fe4d40) 00000020:00000080:1.0:1784044474.900616:0:22743:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1784044474.900864:0:22743:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b397fa43000@MGC192.168.202.140@tcp: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1784044474.901049:0:22743:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.140@tcp-0 is initialized 00000040:01000000:1.0:1784044474.901055:0:22743:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 1 is initialized 10000000:01000000:3.0:1784044474.905051:0:22761:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1784044474.905138:0:22743:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.140@tcp (uuid ccdc2386-7f06-47a4-81d1-1145948bf326) 00000020:00000080:1.0:1784044474.905161:0:22743:0:(genops.c:1406:class_connect()) connect: client ccdc2386-7f06-47a4-81d1-1145948bf326, cookie 0x89871fc3aba19916 00000100:00080000:1.0:1784044474.905200:0:22743:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784044474.905207:0:22743:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9b397fa43000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044474.905249:0:22743:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b384316ed80 x1870705581089024/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044474.905271:0:22743:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ccdc2386-7f06-47a4-81d1-1145948bf326->MGS 00000020:01000004:1.0:1784044474.905294:0:22743:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784044474.905299:0:22743:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784044474.905313:0:22743:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b3970fe19c0) 00000020:00000080:1.0:1784044474.905444:0:22743:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1784044474.913999:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ccdc2386-7f06-47a4-81d1-1145948bf326:3637:1870705581089024:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1784044474.914077:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044474.918841:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581089024 00000100:00100000:3.0:1784044474.918860:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581089024 00000100:00100000:3.0:1784044474.918910:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784044474.918919:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1870705581089024:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1784044474.918960:0:22756:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from ccdc2386-7f06-47a4-81d1-1145948bf326@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:3.0:1784044474.918989:0:22756:0:(genops.c:1406:class_connect()) connect: client ccdc2386-7f06-47a4-81d1-1145948bf326, cookie 0x89871fc3aba19924 00000100:00080000:3.0:1784044474.919198:0:22756:0:(import.c:65:import_set_state_nolock()) ffff9b397aac8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044474.921257:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+5:3637:x1870705581089024:12345-0@lo:250:mount.lustre.0 Request processed in 402us (5244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044474.921279:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784044474.921839:0:3637:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1784044474.921851:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.140@tcp: connect to target with instance 0 00000100:00080000:3.0:1784044474.921861:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1784044474.921866:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1784044474.921870:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397fa43000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1784044474.921873:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1784044474.921884:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1784044474.921890:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ccdc2386-7f06-47a4-81d1-1145948bf326:3637:1870705581089024:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784044474.937854:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044474.938040:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784044474.938046:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1784044474.941106:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1784044474.941117:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784044474.942001:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1784044474.942010:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1784044474.944024:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784044474.944469:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1784044474.944481:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1784044474.945034:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1784044474.945040:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1784044474.997086:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044474.998001:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1784044474.998010:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1784044475.000042:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1784044475.000054:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784044475.001999:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044475.002698:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784044475.002707:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784044475.003931:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784044475.003944:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784044475.004997:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044475.005146:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784044475.005150:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784044475.006120:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784044475.006128:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1784044475.007160:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044475.007827:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784044475.007832:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1784044475.008936:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784044475.008945:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784044475.040562:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044475.041032:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784044475.041039:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784044475.043126:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784044475.043138:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1784044475.045102:0:22743:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784044475.045115:0:22743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784044475.052871:0:22743:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784044475.052904:0:22743:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1784044475.052910:0:22743:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784044475.054118:0:22743:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784044475.054166:0:22743:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1784044475.054171:0:22743:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784044475.054187:0:22743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784044475.054189:0:22743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044475.054190:0:22743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044475.054191:0:22743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044475.054193:0:22743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044475.054194:0:22743:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044475.054195:0:22743:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784044475.054197:0:22743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044475.054198:0:22743:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784044475.054202:0:22743:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1784044475.054204:0:22743:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784044475.054205:0:22743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784044475.054206:0:22743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044475.054207:0:22743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044475.054208:0:22743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044475.054209:0:22743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044475.054210:0:22743:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044475.054211:0:22743:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784044475.054212:0:22743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044475.054213:0:22743:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784044475.054242:0:22743:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784044475.054262:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089152:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784044475.054474:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044475.054590:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f9229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044475.054918:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581089152 00000100:00100000:1.0:1784044475.055018:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581089152 00000100:00100000:1.0:1784044475.055139:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044475.055151:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+5:22743:x1870705581089152:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784044475.055252:0:22759:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784044475.055256:0:22759:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784044475.055260:0:22759:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1784044475.056011:0:22780:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784044475.056862:0:22759:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1784044475.060984:0:22781:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1784044475.060993:0:22781:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1784044475.060996:0:22781:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1784044475.060999:0:22781:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1784044475.062537:0:22781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1784044475.063163:0:22759:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784044475.063303:0:22759:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784044475.067532:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+5:22743:x1870705581089152:12345-0@lo:253:mount.lustre.0 Request processed in 12368us (13042us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044475.067717:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089152:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784044475.067754:0:22743:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784044475.067758:0:22743:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784044475.067771:0:22743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784044475.067773:0:22743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044475.067774:0:22743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044475.067775:0:22743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044475.067777:0:22743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044475.067778:0:22743:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044475.067780:0:22743:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784044475.067782:0:22743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044475.067783:0:22743:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784044475.067808:0:22743:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b38431d5800 from lustre-MDT0000 10000000:01000000:3.0:1784044475.067851:0:22743:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784044475.067855:0:22743:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784044475.067860:0:22743:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b3970fe4d40 10000000:01000000:3.0:1784044475.067864:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044475.067873:0:22743:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b3970fe4d40 from 1 10000000:01000000:3.0:1784044475.067876:0:22743:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784044475.067931:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044475.067943:0:22743:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044475.067953:0:22743:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044475.067974:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044475.068017:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044475.068062:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39450d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044475.068209:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581089280 00000100:00100000:0.0:1784044475.068216:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581089280 00000100:00100000:0.0:1784044475.068256:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044475.068266:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+6:22743:x1870705581089280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044475.068288:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044475.068303:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3940030800/0x89871fc3aba19932 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba1992b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044475.068336:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940030800/0x89871fc3aba19932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba1992b expref: 7 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044475.068347:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3940030800/0x89871fc3aba19932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1992b expref: 7 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044475.068356:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3940030800, rc 0) 00000100:00100000:0.0:1784044475.068396:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+7:22743:x1870705581089280:12345-0@lo:101:mount.lustre.0 Request processed in 132us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044475.068404:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044475.068848:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044475.069029:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044475.069045:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044475.069066:0:22743:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044475.069126:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044475.069157:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044475.069204:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39450d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044475.069951:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581089408 00000100:00100000:0.0:1784044475.069958:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581089408 00000100:00100000:0.0:1784044475.070008:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044475.070017:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+6:22743:x1870705581089408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044475.070119:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+6:22743:x1870705581089408:12345-0@lo:501:mount.lustre.0 Request processed in 102us (960us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784044475.070126:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044475.070514:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089408:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784044475.070561:0:22743:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784044475.070574:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044475.070583:0:22743:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044475.070591:0:22743:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b38431d5800 10000000:01000000:3.0:1784044475.070596:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784044475.070601:0:22743:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b38431d5800 10000000:01000000:3.0:1784044475.070830:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784044475.070834:0:22743:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9b38431d5800 from 1 10000000:01000000:3.0:1784044475.070837:0:22743:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784044475.070866:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba19939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044475.070875:0:22743:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba19939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044475.070883:0:22743:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba19939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044475.070908:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089536:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044475.070962:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044475.071032:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39450d86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044475.071456:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581089536 00000100:00100000:1.0:1784044475.071462:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581089536 00000100:00100000:1.0:1784044475.071563:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784044475.071575:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+6:22743:x1870705581089536:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044475.071588:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044475.071614:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b397cb18600/0x89871fc3aba19940 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19939 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.071636:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b397cb18600/0x89871fc3aba19940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19939 expref: 7 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.071646:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b397cb18600/0x89871fc3aba19940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19939 expref: 7 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.071654:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b397cb18600, rc 0) 00000100:00100000:1.0:1784044475.071708:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+7:22743:x1870705581089536:12345-0@lo:101:mount.lustre.0 Request processed in 136us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044475.071714:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044475.071786:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044475.071801:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba19939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19940 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044475.071812:0:22743:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba19939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19940 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044475.071826:0:22743:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784044475.071846:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba19939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19940 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044475.071853:0:22743:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba19939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19940 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044475.071859:0:22743:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784044475.071862:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044475.071867:0:22743:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b38431d5800 10000000:01000000:3.0:1784044475.071870:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784044475.071873:0:22743:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784044475.071875:0:22743:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784044475.071890:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054800/0x89871fc3aba19947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044475.071898:0:22743:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982054800/0x89871fc3aba19947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044475.071914:0:22743:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982054800/0x89871fc3aba19947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044475.071948:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044475.071975:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044475.072504:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39450d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044475.072744:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581089664 00000100:00100000:0.0:1784044475.072749:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581089664 00000100:00100000:0.0:1784044475.072782:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044475.072788:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+7:22743:x1870705581089664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044475.072796:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044475.072806:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3940031200/0x89871fc3aba1994e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19947 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044475.072821:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940031200/0x89871fc3aba1994e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19947 expref: 8 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044475.072830:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3940031200/0x89871fc3aba1994e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19947 expref: 8 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044475.072837:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3940031200, rc 0) 00000100:00100000:0.0:1784044475.072910:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+8:22743:x1870705581089664:12345-0@lo:101:mount.lustre.0 Request processed in 121us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044475.072916:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784044475.073124:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044475.073137:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982054800/0x89871fc3aba19947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1994e expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044475.073146:0:22743:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982054800/0x89871fc3aba19947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1994e expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044475.073231:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044475.073257:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044475.073460:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581089792 00000100:00100000:0.0:1784044475.073465:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581089792 00000100:00100000:0.0:1784044475.073497:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044475.073504:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+8:22743:x1870705581089792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044475.073939:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+9:22743:x1870705581089792:12345-0@lo:501:mount.lustre.0 Request processed in 416us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044475.073948:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784044475.074075:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39450d86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044475.074092:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044475.074147:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044475.074249:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044475.074272:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39450d86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044475.074421:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581089920 00000100:00100000:1.0:1784044475.074426:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581089920 00000100:00100000:1.0:1784044475.074451:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044475.074458:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+9:22743:x1870705581089920:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044475.075518:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+9:22743:x1870705581089920:12345-0@lo:503:mount.lustre.0 Request processed in 1055us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044475.075528:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784044475.075915:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581089920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044475.076920:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22782:1870705581090048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044475.077077:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044475.077117:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044475.077165:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581090048 00000100:00100000:3.0:1784044475.077213:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581090048 00000100:00100000:3.0:1784044475.077246:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784044475.077254:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+9:22782:x1870705581090048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044475.078523:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+9:22782:x1870705581090048:12345-0@lo:502:llog_process_th.0 Request processed in 1264us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044475.078533:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044475.079038:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22782:1870705581090048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044475.079084:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044475.079097:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044475.079099:0:22782:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784044475.079104:0:22782:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784044475.079107:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784044475.079123:0:22782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b3970fe3380) 00000020:00000080:1.0:1784044475.079141:0:22782:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1784044475.079147:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784044475.079657:0:22782:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784044475.079723:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba1995c 00000020:00000080:1.0:1784044475.080056:0:22782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784044475.080061:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044475.080065:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044475.080067:0:22782:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784044475.080070:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044475.080073:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044475.080075:0:22782:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784044475.080078:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784044475.080086:0:22782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b3970fe0000) 00000020:00000080:1.0:1784044475.080097:0:22782:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1784044475.080101:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784044475.080103:0:22782:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784044475.080106:0:22782:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784044475.080112:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784044475.080159:0:22782:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b38431d5800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784044475.080171:0:22782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b39742519c0) 00000020:00000080:1.0:1784044475.080424:0:22782:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1784044475.080506:0:22782:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784044475.080514:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba19971 00000020:00000080:1.0:1784044475.080859:0:22782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784044475.080866:0:22782:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784044475.080871:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x89871fc3aba19978 00080000:01000000:1.0:1784044475.080878:0:22782:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784044475.080882:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba1997f 00010000:00010000:2.0:1784044475.217431:0:22782:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1784044475.218986:0:22782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:2.0:1784044475.220531:0:22782:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784044475.222350:0:22782:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b3947bccd40) 00000020:00000080:2.0:1784044475.222400:0:22782:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784044475.222503:0:22782:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784044475.222511:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba1998d 00000020:00000080:3.0:1784044475.226242:0:22782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784044475.252934:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x89871fc3aba19994 00000020:00000080:1.0:1784044475.253210:0:22782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784044475.253222:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044475.253229:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044475.253231:0:22782:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784044475.253235:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784044475.253237:0:22782:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1784044475.253239:0:22782:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784044475.253241:0:22782:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784044475.253242:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784044475.253245:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044475.253246:0:22782:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784044475.253249:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044475.253254:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044475.253256:0:22782:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784044475.253260:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784044475.253300:0:22782:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784044475.253317:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044475.253334:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044475.253336:0:22782:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784044475.253339:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044475.253342:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044475.253343:0:22782:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1784044475.253346:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784044475.253352:0:22782:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:1.0:1784044475.253380:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784044475.253404:0:22782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9b3974254d40) 00000020:00000080:1.0:1784044475.253419:0:22782:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1784044475.253426:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784044475.253539:0:22782:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784044475.253545:0:22782:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784044475.253552:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba199a2 00010000:00080000:1.0:1784044475.253583:0:22782:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b395820b000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1784044475.255276:0:22782:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1784044475.255814:0:22782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784044475.255827:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1784044475.255861:0:22782:0:(lod_lov.c:129:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784044475.255881:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba199a9 00000100:00080000:1.0:1784044475.255892:0:22782:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784044475.255898:0:22782:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b395820b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044475.259507:0:22782:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b384316fb80 x1870705581090176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044475.259579:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581090176:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784044475.259653:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044475.259743:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581090176 00000100:00100000:2.0:1784044475.259766:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581090176 00000100:00100000:2.0:1784044475.259807:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784044475.259815:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581090176:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1784044475.259833:0:22769:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1784044475.263051:0:22782:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1784044475.263210:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044475.263217:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.263220:0:22782:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1784044475.263224:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784044475.263227:0:22782:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1784044475.263228:0:22782:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784044475.263230:0:22782:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784044475.263231:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784044475.263234:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.263235:0:22782:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784044475.263238:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784044475.263243:0:22782:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784044475.263247:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.263248:0:22782:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784044475.263252:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784044475.263256:0:22782:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:0.0:1784044475.263283:0:22782:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784044475.263286:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784044475.263305:0:22782:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b3842114d40) 00000020:00000080:0.0:1784044475.263710:0:22782:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1784044475.263720:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784044475.263899:0:22782:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784044475.263906:0:22782:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784044475.263914:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba199b7 00010000:00080000:0.0:1784044475.263964:0:22782:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b39513b8800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1784044475.266481:0:22782:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1784044475.272686:0:22782:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784044475.274392:0:22782:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784044475.277578:0:22782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784044475.278428:0:22782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:1.0:1784044475.288153:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581090176:12345-0@lo:38:llog_process_th.0 Request processed in 28326us (28488us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784044475.288216:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1784044475.290492:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b395820b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784044475.290503:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784044475.290508:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581090176:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1784044475.298103:0:22782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1784044475.298797:0:22788:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1784044475.298803:0:22788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784044475.300281:0:22782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784044475.300294:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784044475.300442:0:22782:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784044475.300482:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba199be 00000100:00080000:0.0:1784044475.300494:0:22782:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784044475.300502:0:22782:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b39513b8800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044475.300554:0:22782:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b1c00 x1870705581090304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044475.300582:0:22782:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1784044475.300701:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581090304:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1784044475.300983:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044475.300988:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.300990:0:22782:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784044475.300994:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784044475.300997:0:22782:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1784044475.300999:0:22782:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784044475.301000:0:22782:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784044475.301001:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784044475.301004:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.301005:0:22782:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784044475.301008:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784044475.301012:0:22782:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784044475.301015:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.301016:0:22782:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784044475.301019:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784044475.301023:0:22782:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:0.0:1784044475.301523:0:22782:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784044475.301528:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784044475.301541:0:22782:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b3842110000) 00000020:00000080:0.0:1784044475.301556:0:22782:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1784044475.301562:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784044475.301646:0:22782:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784044475.301652:0:22782:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1784044475.301745:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba199cc 00010000:00080000:0.0:1784044475.301902:0:22782:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3842123800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1784044475.302133:0:22782:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000400:00000100:2.0:1784044475.302269:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581090304 offset 0 length 520: 4 00000040:01000000:0.0:1784044475.302583:0:22782:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784044475.302600:0:22782:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784044475.305952:0:22782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784044475.306474:0:22782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1784044475.306741:0:22782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1784044475.307315:0:22790:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1784044475.307332:0:22790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784044475.308703:0:22782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044475.308783:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784044475.308833:0:22782:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784044475.308856:0:22782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba199d3 00000100:00080000:3.0:1784044475.308868:0:22782:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044475.308873:0:22782:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3842123800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044475.308910:0:22782:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503bed80 x1870705581090432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044475.308949:0:22782:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784044475.309207:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044475.309212:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044475.309214:0:22782:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784044475.309217:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044475.309221:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044475.309222:0:22782:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784044475.309225:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784044475.309227:0:22782:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784044475.309230:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044475.309232:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044475.309233:0:22782:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784044475.309235:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044475.309237:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044475.309251:0:22782:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784044475.309256:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784044475.309291:0:22782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22782:1870705581090560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044475.309383:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044475.309422:0:22782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044475.309534:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581090560 00000100:00100000:1.0:1784044475.309540:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581090560 00000100:00100000:1.0:1784044475.309588:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784044475.309597:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+9:22782:x1870705581090560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044475.309732:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+9:22782:x1870705581090560:12345-0@lo:502:llog_process_th.0 Request processed in 136us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044475.309748:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784044475.309855:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581090432:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1784044475.309885:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581090432 offset 0 length 520: 4 00000100:00100000:3.0:1784044475.310958:0:22782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22782:1870705581090560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044475.311005:0:22782:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044475.311013:0:22782:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044475.311015:0:22782:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784044475.311018:0:22782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1784044475.311315:0:22743:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1784044475.311346:0:22743:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784044475.311366:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054800/0x89871fc3aba19947 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1994e expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.311376:0:22743:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982054800/0x89871fc3aba19947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1994e expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044475.311383:0:22743:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b38431d5800 from 1 10000000:01000000:2.0:1784044475.311386:0:22743:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784044475.311431:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.311439:0:22743:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.311449:0:22743:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044475.311466:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581090688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044475.311524:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044475.311562:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975850f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044475.311597:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581090688 00000100:00100000:1.0:1784044475.311603:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581090688 00000100:00100000:1.0:1784044475.311649:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784044475.311725:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+9:22743:x1870705581090688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044475.311737:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044475.311752:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b397cb18800/0x89871fc3aba199e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba199da expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.311773:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b397cb18800/0x89871fc3aba199e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba199da expref: 10 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.311783:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b397cb18800/0x89871fc3aba199e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba199da expref: 10 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.311792:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b397cb18800, rc 0) 00000100:00100000:1.0:1784044475.311835:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+10:22743:x1870705581090688:12345-0@lo:101:mount.lustre.0 Request processed in 178us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044475.311842:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784044475.311887:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581090688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044475.311902:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.311911:0:22743:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044475.312736:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581090816:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784044475.312782:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044475.312815:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947f6ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044475.312856:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581090816 00000100:00100000:3.0:1784044475.312862:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581090816 00000100:00100000:3.0:1784044475.312899:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784044475.312907:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+10:22743:x1870705581090816:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784044475.312935:0:22759:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784044475.312943:0:22759:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1784044475.313033:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+10:22743:x1870705581090816:12345-0@lo:256:mount.lustre.0 Request processed in 126us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044475.313040:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044475.313077:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581090816:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784044475.314768:0:22743:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784044475.314794:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.314868:0:22743:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044475.314876:0:22743:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b38431d5800 from 1 10000000:01000000:1.0:1784044475.314880:0:22743:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044475.314929:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.314937:0:22743:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.314946:0:22743:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044475.314971:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581090944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044475.315583:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044475.315696:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947f6ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044475.315803:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581090944 00000100:00100000:2.0:1784044475.315810:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581090944 00000100:00100000:2.0:1784044475.315865:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044475.315874:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+10:22743:x1870705581090944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044475.315887:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044475.315904:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39586efc00/0x89871fc3aba199ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba199e8 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.315940:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39586efc00/0x89871fc3aba199ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba199e8 expref: 11 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.315964:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39586efc00/0x89871fc3aba199ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba199e8 expref: 11 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.315973:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586efc00, rc 0) 00000100:00100000:2.0:1784044475.317203:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22743:x1870705581090944:12345-0@lo:101:mount.lustre.0 Request processed in 1323us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044475.317213:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784044475.318056:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581090944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044475.318080:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.318092:0:22743:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044475.318286:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581091072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044475.318350:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044475.318395:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947f6ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044475.318736:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581091072 00000100:00100000:2.0:1784044475.318742:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581091072 00000100:00100000:2.0:1784044475.318830:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044475.318841:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22743:x1870705581091072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044475.319279:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22743:x1870705581091072:12345-0@lo:501:mount.lustre.0 Request processed in 438us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044475.319287:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784044475.319419:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581091072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044475.319456:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581091200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044475.319831:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044475.323526:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947f6ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044475.327346:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581091200 00000100:00100000:3.0:1784044475.327362:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581091200 00000100:00100000:3.0:1784044475.327431:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784044475.327443:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22743:x1870705581091200:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044475.328134:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22743:x1870705581091200:12345-0@lo:503:mount.lustre.0 Request processed in 691us (8300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044475.328145:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044475.328246:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581091200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044475.329133:0:22792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22792:1870705581091328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044475.329240:0:22792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044475.329276:0:22792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975850600 going to sleep for 11 seconds 00000100:00100000:3.0:1784044475.329457:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581091328 00000100:00100000:3.0:1784044475.329464:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581091328 00000100:00100000:3.0:1784044475.329512:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784044475.329520:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22792:x1870705581091328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044475.329961:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22792:x1870705581091328:12345-0@lo:502:llog_process_th.0 Request processed in 441us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044475.329971:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784044475.330076:0:22792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22792:1870705581091328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784044475.330114:0:22792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044475.330123:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.330125:0:22792:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784044475.330131:0:22792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b38431d5800 00000020:00000080:0.0:1784044475.330133:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784044475.330142:0:22792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044475.330144:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.330145:0:22792:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784044475.330147:0:22792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044475.330158:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.330160:0:22792:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784044475.330164:0:22792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b38431d5800 00000020:00000080:0.0:1784044475.330166:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784044475.330239:0:22792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044475.330243:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.330245:0:22792:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784044475.330247:0:22792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044475.330249:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.330250:0:22792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784044475.330254:0:22792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b38431d5800 00000020:00000080:0.0:1784044475.330256:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784044475.330274:0:22792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044475.330277:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.330278:0:22792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784044475.330280:0:22792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044475.330283:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044475.330284:0:22792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784044475.330288:0:22792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b38431d5800 00000020:00000080:0.0:1784044475.330296:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784044475.330463:0:22792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22792:1870705581091456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044475.330501:0:22792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044475.330536:0:22792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044475.330583:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581091456 00000100:00100000:0.0:1784044475.330588:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581091456 00000100:00100000:0.0:1784044475.330622:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044475.330629:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22792:x1870705581091456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044475.330713:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22792:x1870705581091456:12345-0@lo:502:llog_process_th.0 Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044475.330720:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044475.330754:0:22792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22792:1870705581091456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044475.330775:0:22792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044475.330779:0:22792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044475.330781:0:22792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784044475.330784:0:22792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1784044475.331371:0:22743:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1784044475.331395:0:22743:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784044475.331415:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.331425:0:22743:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044475.331470:0:22743:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784044475.331478:0:22743:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b38431d5800 10000000:01000000:2.0:1784044475.331481:0:22743:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b38431d5800 10000000:01000000:2.0:1784044475.331485:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784044475.331490:0:22743:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b38431d5800 from 1 10000000:01000000:2.0:1784044475.331493:0:22743:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784044475.331520:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba199f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.331528:0:22743:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba199f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.331538:0:22743:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba199f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044475.331554:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581091584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044475.331590:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044475.331616:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975850c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044475.331633:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581091584 00000100:00100000:2.0:1784044475.331637:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581091584 00000100:00100000:2.0:1784044475.331735:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784044475.331743:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22743:x1870705581091584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044475.331752:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044475.331765:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39586ef600/0x89871fc3aba199fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba199f6 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.331787:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39586ef600/0x89871fc3aba199fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba199f6 expref: 12 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.331797:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39586ef600/0x89871fc3aba199fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba199f6 expref: 12 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.331815:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ef600, rc 0) 00000100:00100000:2.0:1784044475.331847:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22743:x1870705581091584:12345-0@lo:101:mount.lustre.0 Request processed in 105us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044475.331854:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784044475.331892:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581091584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044475.331905:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba199f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba199fd expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.331914:0:22743:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba199f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba199fd expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044475.332054:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581091712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044475.332079:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044475.332093:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975850c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044475.332106:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581091712 00000100:00100000:2.0:1784044475.332109:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581091712 00000100:00100000:2.0:1784044475.332131:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784044475.332136:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22743:x1870705581091712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044475.332738:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22743:x1870705581091712:12345-0@lo:501:mount.lustre.0 Request processed in 598us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044475.332746:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044475.338357:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581091712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044475.338422:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581091840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044475.338493:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044475.338527:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044475.338853:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581091840 00000100:00100000:2.0:1784044475.338861:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581091840 00000100:00100000:2.0:1784044475.338931:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784044475.338942:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22743:x1870705581091840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044475.339879:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22743:x1870705581091840:12345-0@lo:503:mount.lustre.0 Request processed in 935us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044475.339890:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784044475.340066:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581091840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044475.341120:0:22795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22795:1870705581091968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044475.341815:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044475.341895:0:22795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044475.345103:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581091968 00000100:00100000:2.0:1784044475.345121:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581091968 00000100:00100000:3.0:1784044475.353414:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044475.353436:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22795:x1870705581091968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044475.353613:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22795:x1870705581091968:12345-0@lo:502:llog_process_th.0 Request processed in 185us (11799us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044475.353626:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784044475.357386:0:22795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22795:1870705581091968:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784044475.357478:0:22795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784044475.357497:0:22795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b3947bc8000) 00000020:00000080:2.0:1784044475.357521:0:22795:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1784044475.358202:0:22795:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b38431d5800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784044475.358208:0:22795:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b38431d5800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784044475.358211:0:22795:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b38431d5800 4 00010000:00080000:2.0:1784044475.358589:0:22795:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b38423e0000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1784044475.378913:0:22795:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1784044475.379096:0:22795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784044475.379142:0:22795:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784044475.380105:0:22795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x89871fc3aba19a0b 00000100:00080000:3.0:1784044475.380119:0:22795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044475.380126:0:22795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b38423e0000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044475.380388:0:22795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503bca80 x1870705581092096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044475.380462:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581092096:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044475.380533:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784044475.380598:0:22795:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784044475.380966:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581092096 00000100:00100000:1.0:1784044475.380973:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581092096 00000100:00100000:2.0:1784044475.381163:0:22795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22795:1870705581092224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044475.381237:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044475.381262:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581092224 00000100:00100000:2.0:1784044475.381266:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581092224 00000100:00100000:2.0:1784044475.381299:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784044475.381308:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22795:x1870705581092224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044475.381414:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044475.381421:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581092096:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044475.381430:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22795:x1870705581092224:12345-0@lo:502:llog_process_th.0 Request processed in 123us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044475.381438:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044475.381469:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581092096:12345-0@lo:38:llog_process_th.0 Request processed in 48us (935us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784044475.381475:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784044475.381479:0:22795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044475.381499:0:22795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22795:1870705581092224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044475.381528:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784044475.381535:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b38423e0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044475.381539:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784044475.381542:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581092096:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044475.381543:0:22795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22795:1870705581092352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044475.381572:0:22795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044475.381593:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581092352 00000100:00100000:2.0:1784044475.381596:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581092352 00000100:00100000:2.0:1784044475.381616:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784044475.381622:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22795:x1870705581092352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044475.381692:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22795:x1870705581092352:12345-0@lo:502:llog_process_th.0 Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044475.381699:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784044475.381724:0:22795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044475.381735:0:22795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccdc2386-7f06-47a4-81d1-1145948bf326:22795:1870705581092352:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784044475.381751:0:22795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784044475.381801:0:22743:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784044475.381821:0:22743:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784044475.381837:0:22743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba199f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba199fd expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044475.381848:0:22743:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba199f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba199fd expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784044475.381897:0:22743:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784044475.381900:0:22743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784044475.381901:0:22743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044475.381903:0:22743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044475.381904:0:22743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044475.381905:0:22743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044475.381907:0:22743:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784044475.381908:0:22743:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784044475.381910:0:22743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044475.381915:0:22743:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784044475.381932:0:22743:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784044475.381935:0:22743:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784044475.381936:0:22743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784044475.381937:0:22743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044475.381938:0:22743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044475.381939:0:22743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044475.381940:0:22743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044475.381941:0:22743:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784044475.381941:0:22743:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784044475.381942:0:22743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044475.381943:0:22743:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784044475.381954:0:22743:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784044475.381961:0:22743:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581092480:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784044475.381999:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044475.382013:0:22743:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044475.382033:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581092480 00000100:00100000:2.0:1784044475.382036:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581092480 00000100:00100000:2.0:1784044475.382056:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044475.382063:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22743:x1870705581092480:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784044475.382083:0:22756:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784044475.382097:0:22756:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784044475.395124:0:22756:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784044475.395157:0:22756:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784044475.395229:0:22780:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784044475.395234:0:22780:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784044475.395257:0:22780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044475.395276:0:22780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b397cb18800/0x89871fc3aba199e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba199da expref: 12 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044475.395285:0:22780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044475.395342:0:22780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b397cb18800/0x89871fc3aba199e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba199da expref: 12 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044475.395357:0:22780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b397cb18800/0x89871fc3aba199e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba199da expref: 12 pid: 22758 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044475.395372:0:22780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581092608:0@lo:104: 00000100:00100000:0.0:1784044475.395440:0:22780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044475.395489:0:22780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f229240 going to sleep for 11 seconds 00000100:00100000:1.0:1784044475.395533:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581092608 00000100:00100000:1.0:1784044475.395541:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581092608 00000100:00100000:1.0:1784044475.395595:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044475.395606:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:22780:x1870705581092608:12345-0@lo:104: 00010000:00010000:1.0:1784044475.395620:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.395671:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044475.395677:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:22780:x1870705581092608:12345-0@lo:104: Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044475.395700:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1784044475.395723:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044475.395728:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044475.395729:0:22780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581092608:0@lo:104: 00010000:00010000:1.0:1784044475.395736:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044475.395740:0:22753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.395747:0:22753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044475.395755:0:22753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044475.395762:0:22753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784044475.395764:0:22780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.395797:0:22753:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.395803:0:22753:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044475.395830:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.395837:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba199da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba199e1 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.395855:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044475.395857:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044475.395858:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044475.396250:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581092736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044475.396281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044475.396342:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581092736 00000100:00100000:1.0:1784044475.396350:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581092736 00010000:00010000:1.0:1784044475.396369:0:22749:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b397cb18800/0x89871fc3aba199e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba199da expref: 13 pid: 22758 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044475.396397:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044475.396404:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+13:3638:x1870705581092736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044475.396415:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044475.396420:0:22749:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b397cb18800/0x89871fc3aba199e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba199da expref: 13 pid: 22758 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396430:0:22749:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b397cb18800/0x89871fc3aba199e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba199da expref: 13 pid: 22758 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396444:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b397cb18800/0x89871fc3aba199e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba199da expref: 13 pid: 22758 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396456:0:22749:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396464:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784044475.396475:0:22749:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001242067s 00010000:00010000:1.0:1784044475.396479:0:22749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396486:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396493:0:22749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396510:0:22749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396516:0:22749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3940030200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044475.396520:0:22749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396527:0:22749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396543:0:22749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396553:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044475.396583:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+12:3638:x1870705581092736:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044475.396590:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044475.396617:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581092736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044475.396633:0:22780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396639:0:22780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044475.396645:0:22780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940030200/0x89871fc3aba19a12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044475.396961:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22743:x1870705581092480:12345-0@lo:253:mount.lustre.0 Request processed in 14898us (14960us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044475.396970:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784044475.397080:0:22743:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:22743:1870705581092480:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784044475.397092:0:22743:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784044475.397094:0:22743:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784044475.397096:0:22743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784044475.397097:0:22743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044475.397098:0:22743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044475.397100:0:22743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044475.397101:0:22743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044475.397102:0:22743:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044475.397104:0:22743:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784044475.397106:0:22743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044475.397108:0:22743:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784044475.397120:0:22743:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1784044475.431217:0:22743:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1784044475.431537:0:22743:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784044475.431641:0:22804:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1784044475.431645:0:22804:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:2.0:1784044475.431966:0:22805:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784044475.432205:0:22743:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1784044475.432341:0:22805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1784044475.434292:0:22806:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9b39503bdc00 x1870705581092864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044475.434307:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00000040:01000000:0.0:1784044475.436218:0:22743:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784044475.436268:0:22743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784044475.437291:0:22743:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784044475.437307:0:22743:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784044475.437377:0:22743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044475.438168:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784044475.438396:0:22805:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1784044475.439476:0:22743:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784044475.439989:0:22743:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784044475.440021:0:22743:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1784044475.441613:0:22743:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1784044475.447279:0:22743:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1784044475.457613:0:22743:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1784044475.461072:0:22743:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784044475.461112:0:22743:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb73bc175f988 00100000:10000000:1.0:1784044475.461132:0:22743:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1784044475.462119:0:22743:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784044475.462134:0:22743:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784044475.462155:0:22743:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784044475.462196:0:22743:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1784044475.464333:0:22743:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784044475.464592:0:22743:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784044475.927561:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044476.434985:0:22800:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784044476.435005:0:22800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044476.438327:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1784044476.438343:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1784044476.495830:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 10000000:01000000:2.0:1784044476.749327:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784044476.749340:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b38431d5800 from 11 10000000:01000000:2.0:1784044476.749347:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784044476.749448:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044476.749462:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044476.749474:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044476.749506:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581092992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044476.749587:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044476.749653:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420dbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044476.749668:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581092992 00000100:00100000:0.0:1784044476.749678:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581092992 00000100:00100000:0.0:1784044476.749742:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784044476.749752:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+11:22761:x1870705581092992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044476.749766:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044476.749788:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3940031800/0x89871fc3aba19a20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19a19 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044476.749823:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940031800/0x89871fc3aba19a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19a19 expref: 12 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044476.749834:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3940031800/0x89871fc3aba19a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19a19 expref: 12 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044476.749843:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3940031800, rc 0) 00000100:00100000:0.0:1784044476.749898:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22761:x1870705581092992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044476.749934:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784044476.750100:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581092992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044476.750129:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044476.750137:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044476.750223:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581093120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784044476.750257:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044476.750277:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3844627600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044476.750339:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581093120 00000100:00100000:0.0:1784044476.750344:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581093120 00000100:00100000:0.0:1784044476.750382:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784044476.750390:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22761:x1870705581093120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784044476.750405:0:22756:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784044476.750424:0:22756:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784044476.750427:0:22756:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1784044476.750687:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+12:22761:x1870705581093120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 296us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044476.750694:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784044476.750766:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581093120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784044476.750825:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784044476.750833:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044476.750842:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044476.942372:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044477.454279:0:22800:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784044477.454292:0:22800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044477.454427:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1784044477.454465:0:22800:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044477.454619:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1784044477.521317:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:0.0:1784044477.966008:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044478.541279:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:1.0:1784044479.001390:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044479.577784:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:3.0:1784044480.014867:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044480.590056:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00000100:00080000:0.0:1784044480.591026:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784044480.591032:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784044480.591035:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b395820b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044480.591043:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 668 00000100:00080000:0.0:1784044480.591049:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784044480.591054:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b395820b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044480.591078:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b3800 x1870705581093376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044480.591094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044480.591098:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044480.591100:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044480.591103:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044480.591105:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784044480.591108:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784044480.591110:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b38423e0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044480.591114:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b38423e0000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044480.591127:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b1880 x1870705581093504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044480.591148:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044480.591161:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581093248:0@lo:400:kworker.0 00000100:00100000:0.0:1784044480.591564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044480.591656:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581093376:0@lo:38:kworker.0 00000100:00100000:0.0:1784044480.591723:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044480.591744:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581093504:0@lo:38:kworker.0 00000100:00100000:0.0:1784044480.591804:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044480.591869:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581093376 00000100:00100000:0.0:1784044480.591887:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581093376 00000100:00100000:0.0:1784044480.591924:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044480.591931:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581093376:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784044480.591950:0:22770:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784044480.591990:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581093376:12345-0@lo:38:kworker.0 Request processed in 58us (267us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044480.592010:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044480.592214:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581093248 00000100:00100000:3.0:1784044480.592219:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581093248 00000100:00100000:3.0:1784044480.592263:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784044480.592270:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+12:3638:x1870705581093248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044480.592315:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+12:3638:x1870705581093248:12345-0@lo:400:kworker.0 Request processed in 46us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044480.592320:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784044480.592364:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581093248:0@lo:400:kworker.0 00000100:00080000:0.0:1784044480.592667:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b395820b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044480.592672:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784044480.592675:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581093376:0@lo:38:kworker.0 00000100:00100000:0.0:1784044480.592736:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581093504 00000100:00100000:0.0:1784044480.592740:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581093504 00000100:00100000:0.0:1784044480.592770:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044480.592774:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1870705581093504:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784044480.592791:0:22766:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:0.0:1784044480.592823:0:22766:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x89871fc3aba19a27 00000004:00100000:0.0:1784044480.592836:0:22766:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784044480.592991:0:22766:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044480.594011:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870705581093504:12345-0@lo:38:kworker.0 Request processed in 1232us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044480.594027:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784044480.611904:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b39503b1880 x1870705581093504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784044480.611928:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1784044480.611939:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784044480.611945:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784044480.611949:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b38423e0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784044480.611958:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581093504:0@lo:38:kworker.0 00000001:02000400:0.0:1784044480.780243:0:23049:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784044481.047489:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044481.614108:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00000020:00000004:3.0:1784044481.987953:0:23101:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784044481.988633:0:23101:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784044482.066393:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044482.647218:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:3.0:1784044483.091552:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784044483.362687:0:23151:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784044483.362856:0:23151:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784044483.662852:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:0.0:1784044484.116249:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044484.685546:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:3.0:1784044485.134308:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044485.709352:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044475/real 1784044475] req@ffff9b39503bed80 x1870705581090432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044485 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784044485.709353:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784044485.709369:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784044485.709380:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b395820b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044485.709391:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:0.0:1784044485.709396:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784044485.709405:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b395820b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044485.709411:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b39503bed80 x1870705581090432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044485 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044485.709429:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044475/real 1784044475] req@ffff9b39503b1c00 x1870705581090304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044485 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044485.709435:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b2a00 x1870705581093760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784044485.709456:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b39503b1c00 x1870705581090304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044485 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784044485.709461:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044485.709477:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044485.709480:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044485.709483:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784044485.709500:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581093760:0@lo:38:kworker.0 00000100:00100000:1.0:1784044485.709748:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044485.709804:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581093632:0@lo:400:kworker.0 00000100:00100000:2.0:1784044485.709870:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044485.709892:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1784044485.709908:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1784044485.709912:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784044485.709917:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581093888:0@lo:400:kworker.0 00000100:00100000:1.0:1784044485.709919:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581090432:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1784044485.709930:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39513b8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044485.709936:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784044485.709949:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581090304:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784044485.709978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044485.709984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044485.709988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784044485.709991:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b39513b8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784044485.710065:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581093632 00000100:00100000:2.0:1784044485.710078:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581093632 00000100:00100000:2.0:1784044485.710122:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784044485.710131:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+12:3640:x1870705581093632:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784044485.710205:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 668 00000100:00100000:2.0:1784044485.710209:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+12:3640:x1870705581093632:12345-0@lo:400:kworker.0 Request processed in 77us (338us total) trans 0 rc 0/0 00000100:00080000:1.0:1784044485.710211:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784044485.710218:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b39513b8800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044485.710222:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784044485.710240:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b384316f100 x1870705581094016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044485.710257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044485.710260:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784044485.710262:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044485.710266:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 668 00000100:00080000:1.0:1784044485.710268:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784044485.710272:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3842123800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044485.710273:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581093888 00000100:00100000:2.0:1784044485.710279:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581093888 00000100:00100000:1.0:1784044485.710286:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b384316e680 x1870705581094144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044485.710310:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784044485.710318:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581093888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044485.710327:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581094016:0@lo:8:kworker.0 00000400:00000100:1.0:1784044485.710363:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581094016 offset 0 length 520: 4 00000100:00100000:2.0:1784044485.710370:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581093888:12345-0@lo:400:kworker.0 Request processed in 51us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044485.710378:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044485.710383:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581094144:0@lo:8:kworker.0 00000400:00000100:1.0:1784044485.710405:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581094144 offset 0 length 520: 4 00010000:00080000:2.0:1784044485.710421:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b39503b3100 x1870705581093888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044485.710435:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581093888:0@lo:400:kworker.0 00000100:00100000:2.0:1784044485.710450:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581093632:0@lo:400:kworker.0 00000100:00100000:0.0:1784044485.710757:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581093760 00000100:00100000:0.0:1784044485.710764:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581093760 00000100:00100000:0.0:1784044485.710970:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044485.710976:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581093760:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784044485.711001:0:22770:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784044485.711057:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581093760:12345-0@lo:38:kworker.0 Request processed in 79us (1310us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044485.711063:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1784044485.711128:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b395820b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784044485.711133:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784044485.711136:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581093760:0@lo:38:kworker.0 00000100:00100000:1.0:1784044485.713104:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:0.0:1784044486.158521:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044486.734745:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:3.0:1784044487.181313:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044487.702767:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784044487.757243:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:1.0:1784044488.207707:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044488.782909:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:3.0:1784044489.236929:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044489.805409:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:1.0:1784044490.256476:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044490.831336:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00000100:00080000:3.0:1784044490.838923:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784044490.838931:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784044490.838935:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b395820b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044490.838943:0:14129:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:3.0:1784044490.838949:0:14129:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784044490.838955:0:14129:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b395820b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044490.838981:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503be300 x1870705581094400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044490.838998:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044490.839002:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044490.839005:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044490.839009:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044490.839462:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581094528:0@lo:400:kworker.0 00000100:00100000:2.0:1784044490.839578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044490.839643:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044490.839650:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccdc2386-7f06-47a4-81d1-1145948bf326:3639:1870705581094272:0@lo:400:kworker.0 00000100:00100000:2.0:1784044490.839699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044490.839735:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581094400:0@lo:38:kworker.0 00000100:00100000:2.0:1784044490.839793:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044490.842889:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581094528 00000100:00100000:1.0:1784044490.842906:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581094528 00000100:00100000:1.0:1784044490.842970:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044490.842980:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581094528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044490.843089:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581094528:12345-0@lo:400:kworker.0 Request processed in 109us (3510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044490.843097:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044490.843125:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581094400 00000100:00100000:1.0:1784044490.843128:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581094400 00000100:00100000:1.0:1784044490.843150:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044490.843155:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581094400:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784044490.843192:0:22769:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784044490.843231:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581094400:12345-0@lo:38:kworker.0 Request processed in 74us (3437us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784044490.843238:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784044490.843282:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b39503bd880 x1870705581094528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044490.843299:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581094528:0@lo:400:kworker.0 00000100:00080000:1.0:1784044490.843337:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b395820b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044490.843342:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044490.843345:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581094400:0@lo:38:kworker.0 00000100:00100000:3.0:1784044490.844941:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581094272 00000100:00100000:3.0:1784044490.844955:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581094272 00000100:00100000:3.0:1784044490.845017:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784044490.845035:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+12:3639:x1870705581094272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044490.845132:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+12:3639:x1870705581094272:12345-0@lo:400:kworker.0 Request processed in 99us (5432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044490.845140:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784044490.845226:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccdc2386-7f06-47a4-81d1-1145948bf326:3639:1870705581094272:0@lo:400:kworker.0 00010000:00010000:3.0:1784044491.277327:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044491.854305:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:2.0:1784044492.310058:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784044492.782466:0:23499:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784044492.782471:0:23499:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1784044492.782472:0:23499:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1784044492.782923:0:23499:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b396f3cb000 00000020:01000004:3.0:1784044492.782939:0:23499:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1784044492.782952:0:23499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784044492.782966:0:23499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9b39459bcd40) 00000020:00000080:3.0:1784044492.782983:0:23499:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784044492.834945:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.836054:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784044492.836607:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1784044492.837024:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784044492.837635:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1784044492.838820:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1784044492.839079:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1784044492.839348:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1784044492.839530:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1784044492.839748:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1784044492.840000:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1784044492.840238:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784044492.840449:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1784044492.840648:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784044492.843641:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.843887:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.844101:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.845629:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.845958:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.846264:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.846571:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.846857:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.847085:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.847409:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.847632:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.847830:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.848029:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.848339:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.848613:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.848818:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.849028:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.849341:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.849545:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.850453:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.850712:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.850944:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.851150:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.851527:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.851751:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.851991:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.852436:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.852776:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.852992:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.853348:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1784044492.853594:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1784044492.853804:0:23499:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00080000:01000000:3.0:1784044492.856798:0:23499:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784044492.857047:0:23499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1784044492.857058:0:23499:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784044492.857070:0:23499:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba19a35 00000020:01000004:3.0:1784044492.857077:0:23499:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1784044492.857100:0:23499:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784044492.857104:0:23499:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784044492.857110:0:23499:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1784044492.857135:0:23499:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1784044492.857139:0:23499:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1784044492.863589:0:23499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784044492.863627:0:23499:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1784044492.863631:0:23499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784044492.863633:0:23499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784044492.863635:0:23499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044492.863636:0:23499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044492.863638:0:23499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044492.863639:0:23499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044492.863640:0:23499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784044492.863642:0:23499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044492.863644:0:23499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784044492.863647:0:23499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1784044492.863649:0:23499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784044492.863651:0:23499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784044492.863652:0:23499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044492.863653:0:23499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044492.863654:0:23499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044492.863655:0:23499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044492.863656:0:23499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784044492.863657:0:23499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044492.863658:0:23499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784044492.863682:0:23499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1784044492.863701:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581094656:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784044492.863788:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044492.863829:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455d9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044492.864041:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581094656 00000100:00100000:3.0:1784044492.864049:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581094656 00000100:00100000:3.0:1784044492.864106:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044492.864116:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+12:23499:x1870705581094656:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784044492.864147:0:22758:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784044492.864150:0:22758:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1784044492.864168:0:22758:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1784044492.864603:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+12:23499:x1870705581094656:12345-0@lo:253:mount.lustre.0 Request processed in 487us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044492.864611:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784044492.864697:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581094656:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784044492.864714:0:23499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784044492.864716:0:23499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784044492.864718:0:23499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784044492.864719:0:23499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044492.864720:0:23499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044492.864721:0:23499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044492.864722:0:23499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044492.864723:0:23499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784044492.864724:0:23499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044492.864725:0:23499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784044492.864741:0:23499:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b396f3cb000 from lustre-MDT0001 10000000:01000000:2.0:1784044492.864778:0:23499:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1784044492.864782:0:23499:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784044492.864789:0:23499:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b3970fe4d40 local copy 00010000:00010000:2.0:1784044492.864799:0:23499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044492.864884:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581094784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044492.864913:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044492.864941:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455d9780 going to sleep for 11 seconds 00000100:00100000:3.0:1784044492.864983:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581094784 00000100:00100000:3.0:1784044492.864988:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581094784 00000100:00100000:3.0:1784044492.865060:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784044492.865067:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+12:23499:x1870705581094784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044492.865140:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+12:23499:x1870705581094784:12345-0@lo:501:mount.lustre.0 Request processed in 73us (226us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044492.865147:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784044492.865235:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581094784:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784044492.865247:0:23499:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784044492.865263:0:23499:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784044492.865270:0:23499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.865279:0:23499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044492.865305:0:23499:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b396f3cb000 10000000:01000000:2.0:1784044492.865315:0:23499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784044492.865320:0:23499:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b3970fe4d40 10000000:01000000:2.0:1784044492.865323:0:23499:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1784044492.865326:0:23499:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9b3970fe4d40 from 1 10000000:01000000:2.0:1784044492.865329:0:23499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784044492.865352:0:23499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba19a3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.865360:0:23499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba19a3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.865370:0:23499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba19a3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044492.865383:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581094912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044492.865406:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044492.865983:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455d9780 going to sleep for 11 seconds 00000100:00100000:0.0:1784044492.866050:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581094912 00000100:00100000:0.0:1784044492.866056:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581094912 00000100:00100000:1.0:1784044492.866399:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784044492.866408:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+12:23499:x1870705581094912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044492.866420:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044492.866443:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b397cb18a00/0x89871fc3aba19a43 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19a3c expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044492.866468:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b397cb18a00/0x89871fc3aba19a43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19a3c expref: 13 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044492.866478:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b397cb18a00/0x89871fc3aba19a43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19a3c expref: 13 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044492.866487:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b397cb18a00, rc 0) 00000100:00100000:1.0:1784044492.866548:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+13:23499:x1870705581094912:12345-0@lo:101:mount.lustre.0 Request processed in 142us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044492.866555:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784044492.866622:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581094912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044492.866638:0:23499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba19a3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a43 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.866646:0:23499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba19a3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19a43 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044492.866664:0:23499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784044492.866683:0:23499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba19a3c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a43 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.866690:0:23499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba19a3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a43 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044492.866710:0:23499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b396f3cb000 10000000:01000000:2.0:1784044492.866714:0:23499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784044492.866718:0:23499:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9b396f3cb000 from 1 10000000:01000000:2.0:1784044492.866720:0:23499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784044492.866738:0:23499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba19a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.866745:0:23499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba19a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.866752:0:23499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba19a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044492.866779:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044492.866807:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044492.868395:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455d9780 going to sleep for 11 seconds 00000100:00100000:3.0:1784044492.868563:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581095040 00000100:00100000:3.0:1784044492.868572:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581095040 00000100:00100000:3.0:1784044492.868614:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784044492.868624:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+13:23499:x1870705581095040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044492.868638:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044492.868655:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982054e00/0x89871fc3aba19a51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19a4a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044492.868680:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982054e00/0x89871fc3aba19a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19a4a expref: 14 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044492.868691:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982054e00/0x89871fc3aba19a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19a4a expref: 14 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044492.868699:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982054e00, rc 0) 00000100:00100000:3.0:1784044492.868818:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+14:23499:x1870705581095040:12345-0@lo:101:mount.lustre.0 Request processed in 195us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044492.868825:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784044492.868959:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044492.868975:0:23499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba19a4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a51 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.868985:0:23499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba19a4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19a51 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044492.869002:0:23499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784044492.869052:0:23499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba19a4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a51 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.869060:0:23499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba19a4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a51 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044492.869082:0:23499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784044492.869086:0:23499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784044492.869092:0:23499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b396f3cb000 10000000:01000000:2.0:1784044492.869094:0:23499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784044492.869098:0:23499:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1784044492.869101:0:23499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784044492.869126:0:23499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef400/0x89871fc3aba19a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.869134:0:23499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586ef400/0x89871fc3aba19a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.869143:0:23499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586ef400/0x89871fc3aba19a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044492.869419:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044492.869695:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044492.869727:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455d9780 going to sleep for 11 seconds 00000100:00100000:3.0:1784044492.869781:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581095168 00000100:00100000:3.0:1784044492.869787:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581095168 00000100:00100000:3.0:1784044492.869829:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784044492.869836:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+14:23499:x1870705581095168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044492.869844:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044492.869854:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982055600/0x89871fc3aba19a5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19a58 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044492.869884:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982055600/0x89871fc3aba19a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19a58 expref: 15 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044492.869904:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982055600/0x89871fc3aba19a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19a58 expref: 15 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044492.869912:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982055600, rc 0) 00000100:00100000:3.0:1784044492.869950:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+15:23499:x1870705581095168:12345-0@lo:101:mount.lustre.0 Request processed in 114us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044492.869956:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044492.870336:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044492.870351:0:23499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586ef400/0x89871fc3aba19a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a5f expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044492.870361:0:23499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586ef400/0x89871fc3aba19a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19a5f expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044492.872485:0:23499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1784044492.874782:0:23499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044492.877391:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00000040:00080000:2.0:1784044492.882477:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1784044492.882822:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1784044492.882841:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1784044492.882854:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1784044492.882866:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1784044492.882879:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1784044492.882890:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1784044492.882905:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1784044492.882920:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1784044492.882934:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1784044492.882957:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1784044492.882969:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1784044492.882982:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1784044492.882997:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1784044492.883011:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1784044492.883026:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1784044492.883041:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1784044492.883055:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1784044492.883068:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1784044492.883080:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1784044492.883091:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1784044492.883105:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1784044492.883118:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1784044492.883130:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1784044492.883142:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1784044492.883153:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1784044492.884487:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1784044492.884586:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1784044492.884602:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1784044492.884756:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1784044492.884788:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1784044492.884803:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1784044492.884815:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1784044492.884827:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1784044492.884862:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1784044492.884876:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1784044492.884888:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1784044492.884898:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1784044492.884909:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1784044492.884922:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1784044492.884934:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1784044492.884948:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1784044492.884960:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1784044492.884972:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1784044492.885009:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1784044492.885016:0:23499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1784044492.885129:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044492.885814:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044492.885910:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455d9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044492.894214:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581095296 00000100:00100000:1.0:1784044492.894430:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581095296 00000100:00100000:2.0:1784044492.894571:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044492.894583:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+15:23499:x1870705581095296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044492.894834:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+15:23499:x1870705581095296:12345-0@lo:501:mount.lustre.0 Request processed in 253us (9020us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044492.894842:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784044492.895348:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044492.895401:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044492.895468:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044492.895509:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3842748900 going to sleep for 11 seconds 00000100:00100000:0.0:1784044492.895607:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581095424 00000100:00100000:0.0:1784044492.895611:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581095424 00000100:00100000:0.0:1784044492.895635:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784044492.895640:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+15:23499:x1870705581095424:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044492.896671:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+15:23499:x1870705581095424:12345-0@lo:503:mount.lustre.0 Request processed in 1025us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044492.896682:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784044492.896773:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784044492.897143:0:23499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784044492.897426:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044492.897469:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044492.897557:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455d9780 going to sleep for 11 seconds 00000100:00100000:0.0:1784044492.897824:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581095552 00000100:00100000:0.0:1784044492.897830:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581095552 00000100:00100000:0.0:1784044492.897906:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784044492.897913:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+15:23499:x1870705581095552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044492.898541:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+15:23499:x1870705581095552:12345-0@lo:502:mount.lustre.0 Request processed in 628us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044492.898548:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784044492.898620:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784044492.898863:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1784044492.898892:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1784044492.898908:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1784044492.898921:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1784044492.898932:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1784044492.898947:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1784044492.898955:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1784044492.898962:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1784044492.898969:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1784044492.898976:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1784044492.898985:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1784044492.898992:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1784044492.898999:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1784044492.899010:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1784044492.899023:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1784044492.899035:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1784044492.899048:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1784044492.899061:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1784044492.899076:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1784044492.899090:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1784044492.899100:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1784044492.899107:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1784044492.899114:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1784044492.899122:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1784044492.899128:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1784044492.899137:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1784044492.899144:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1784044492.899151:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1784044492.899361:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1784044492.899382:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1784044492.899396:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1784044492.899409:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1784044492.899422:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1784044492.899435:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1784044492.899447:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1784044492.899459:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1784044492.899472:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1784044492.899484:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1784044492.899605:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1784044492.899624:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1784044492.899638:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1784044492.899651:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1784044492.899665:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1784044492.899677:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1784044492.899711:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784044492.899773:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044492.899813:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38427486c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044492.899876:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581095680 00000100:00100000:2.0:1784044492.899882:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581095680 00000100:00100000:2.0:1784044492.899965:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784044492.899979:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+15:23499:x1870705581095680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044492.900079:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+15:23499:x1870705581095680:12345-0@lo:502:mount.lustre.0 Request processed in 101us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044492.900086:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784044492.900187:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581095680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784044492.900239:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1784044492.900248:0:23499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1784044492.901086:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044492.901097:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044492.901100:0:23503:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1784044492.901105:0:23503:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1784044492.901108:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784044492.901122:0:23503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9b3974250000) 00000020:00000080:1.0:1784044492.901146:0:23503:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1784044492.901152:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784044492.901363:0:23503:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784044492.901371:0:23503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba19a6d 00000020:00000080:1.0:1784044492.901853:0:23503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1784044492.901859:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044492.901862:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044492.901864:0:23503:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1784044492.901867:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044492.901871:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044492.901873:0:23503:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1784044492.901876:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784044492.901886:0:23503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9b3974253380) 00000020:00000080:1.0:1784044492.901908:0:23503:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1784044492.901913:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784044492.901916:0:23503:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1784044492.901919:0:23503:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1784044492.901925:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784044492.901989:0:23503:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b396f3cb000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1784044492.902012:0:23503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9b394734cd40) 00000020:00000080:1.0:1784044492.902022:0:23503:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1784044492.902088:0:23503:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784044492.902095:0:23503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba19a82 00000020:00000080:1.0:1784044492.903370:0:23503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1784044492.903382:0:23503:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784044492.903390:0:23503:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x89871fc3aba19a89 00080000:01000000:1.0:1784044492.903399:0:23503:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784044492.903403:0:23503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba19a90 00010000:00010000:0.0:1784044492.990964:0:23503:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1784044492.991484:0:23503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1784044492.991864:0:23503:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784044492.992960:0:23503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1784044492.992972:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044492.992978:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044492.992980:0:23503:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1784044492.992984:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044492.992989:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044492.992991:0:23503:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1784044492.992994:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784044492.992999:0:23503:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:3.0:1784044492.993030:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784044492.993047:0:23503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9b39459b8000) 00000020:00000080:3.0:1784044492.993067:0:23503:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1784044492.993072:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784044492.993225:0:23503:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1784044492.993232:0:23503:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784044492.993241:0:23503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba19a9e 00010000:00080000:3.0:1784044492.993273:0:23503:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b39459d0800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1784044492.995779:0:23503:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1784044492.998949:0:23503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784044492.998964:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784044492.999007:0:23503:0:(lod_lov.c:129:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784044492.999029:0:23503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba19aa5 00000100:00080000:3.0:1784044492.999039:0:23503:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044492.999045:0:23503:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b39459d0800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044492.999081:0:23503:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503bf100 x1870705581095808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044492.999153:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581095808:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044492.999313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784044492.999397:0:23503:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784044492.999424:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784044492.999429:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784044492.999432:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b395820b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044492.999437:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 684 00000100:00080000:3.0:1784044492.999440:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784044492.999445:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b395820b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044492.999456:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581095808 00000100:00100000:0.0:1784044492.999464:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581095808 00000100:00100000:3.0:1784044492.999474:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503bd500 x1870705581095936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044492.999611:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784044492.999618:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581095808:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784044492.999651:0:22769:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:0.0:1784044492.999781:0:22769:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba19aac 00000004:00100000:0.0:1784044492.999795:0:22769:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1784044492.999801:0:22769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1784044493.002784:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581095936:0@lo:38:kworker.0 00000100:00100000:2.0:1784044493.002855:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784044493.004385:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044493.004393:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044493.004396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044493.004399:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1784044493.004546:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044493.004562:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044493.004565:0:23503:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1784044493.004569:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784044493.004572:0:23503:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1784044493.004579:0:23503:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044493.004581:0:23503:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044493.004583:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784044493.004586:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044493.004588:0:23503:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784044493.004591:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044493.004595:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044493.004597:0:23503:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1784044493.004601:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784044493.004652:0:23503:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784044493.004668:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044493.004671:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044493.004673:0:23503:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1784044493.004675:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784044493.004677:0:23503:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1784044493.004678:0:23503:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044493.004680:0:23503:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044493.004682:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784044493.004684:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044493.004686:0:23503:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784044493.004688:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784044493.004691:0:23503:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1784044493.004694:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044493.004695:0:23503:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784044493.004698:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784044493.004702:0:23503:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:3.0:1784044493.004724:0:23503:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1784044493.004726:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784044493.004742:0:23503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9b39459b99c0) 00000020:00000080:3.0:1784044493.004770:0:23503:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1784044493.004777:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784044493.004854:0:23503:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1784044493.004861:0:23503:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784044493.004870:0:23503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba19aba 00010000:00080000:3.0:1784044493.004908:0:23503:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b39703c0800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1784044493.005135:0:23503:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1784044493.006145:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581096064:0@lo:400:kworker.0 00000100:00100000:2.0:1784044493.006246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1784044493.007756:0:23503:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784044493.008201:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1784044493.008850:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581096064 00000100:00100000:0.0:1784044493.008861:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581096064 00000100:00100000:0.0:1784044493.008919:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044493.008931:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581096064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044493.009021:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581096064:12345-0@lo:400:kworker.0 Request processed in 92us (2774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044493.009040:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784044493.009372:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b39503bf800 x1870705581096064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044493.009388:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581096064:0@lo:400:kworker.0 00000100:00080000:3.0:1784044493.010839:0:22769:0:(import.c:65:import_set_state_nolock()) ffff9b39703c5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044493.012421:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1870705581095808:12345-0@lo:38:llog_process_th.0 Request processed in 12795us (13101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044493.012439:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044493.012466:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581095936 00000100:00100000:3.0:1784044493.012473:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581095936 00000100:00100000:1.0:1784044493.012667:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784044493.012675:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581095936:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784044493.012744:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581095936:12345-0@lo:38:kworker.0 Request processed in 68us (9888us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784044493.012750:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044493.013395:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784044493.013407:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1784044493.013416:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784044493.013422:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784044493.013425:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39459d0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784044493.013440:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581095808:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044493.013468:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784044493.013472:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b395820b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784044493.013475:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784044493.013490:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581095936:0@lo:38:kworker.0 00000100:00100000:2.0:1784044493.014834:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581096192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044493.014890:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044493.015011:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581096192 00000100:00100000:0.0:1784044493.015017:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581096192 00000100:00100000:0.0:1784044493.015063:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044493.015071:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1870705581096192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044493.015103:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784044493.015148:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1870705581096192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044493.015155:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1784044493.015408:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784044493.015856:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581096192:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1784044493.015949:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1784044493.016071:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1784044493.016478:0:23508:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1784044493.016482:0:23508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784044493.017139:0:23503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784044493.017151:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784044493.017334:0:23503:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784044493.017356:0:23503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba19ac1 00000100:00080000:1.0:1784044493.017365:0:23503:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784044493.017370:0:23503:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b39703c0800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044493.017405:0:23503:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b384316d180 x1870705581096320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044493.017456:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581096320:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1784044493.017618:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581096320 offset 0 length 520: 4 00000100:00080000:1.0:1784044493.017667:0:23503:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784044493.017719:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044493.017723:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044493.017726:0:23503:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784044493.017729:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784044493.017732:0:23503:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1784044493.017733:0:23503:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784044493.017735:0:23503:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784044493.017736:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784044493.017738:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044493.017740:0:23503:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784044493.017742:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784044493.017745:0:23503:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1784044493.017748:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044493.017750:0:23503:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784044493.017752:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784044493.017756:0:23503:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:1.0:1784044493.017789:0:23503:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1784044493.017792:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784044493.017803:0:23503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9b3947348000) 00000020:00000080:1.0:1784044493.017816:0:23503:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1784044493.017820:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784044493.017877:0:23503:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1784044493.017883:0:23503:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784044493.017889:0:23503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba19acf 00010000:00080000:1.0:1784044493.017917:0:23503:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b39459d2800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1784044493.018136:0:23503:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1784044493.018234:0:23503:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784044493.018250:0:23503:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1784044493.018442:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044493.018447:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044493.018449:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044493.018452:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1784044493.020123:0:23503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784044493.020385:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1784044493.020472:0:23503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1784044493.020790:0:23510:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1784044493.020794:0:23510:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784044493.021440:0:23503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784044493.021450:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784044493.021480:0:23503:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784044493.021509:0:23503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba19ad6 00000100:00080000:0.0:1784044493.021517:0:23503:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784044493.021521:0:23503:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b39459d2800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044493.021550:0:23503:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b1500 x1870705581096448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044493.021654:0:23503:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1784044493.021684:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581096448:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1784044493.021738:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581096448 offset 0 length 520: 4 00000020:01000000:0.0:1784044493.021746:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044493.021749:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044493.021751:0:23503:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784044493.021770:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044493.021774:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044493.021776:0:23503:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784044493.021778:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784044493.021780:0:23503:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784044493.021782:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044493.021784:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044493.021785:0:23503:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784044493.021788:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044493.021790:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044493.021791:0:23503:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784044493.021794:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784044493.021817:0:23503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044493.021820:0:23503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044493.021821:0:23503:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784044493.021823:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1784044493.021878:0:23499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1784044493.021907:0:23499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784044493.021923:0:23499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef400/0x89871fc3aba19a58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a5f expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044493.021934:0:23499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586ef400/0x89871fc3aba19a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19a5f expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044493.021943:0:23499:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f3cb000 from 1 10000000:01000000:2.0:1784044493.021946:0:23499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00080000:3.0:1784044493.021971:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00010000:00010000:2.0:1784044493.021972:0:23499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784044493.021976:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044493.021978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00010000:00010000:2.0:1784044493.021980:0:23499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784044493.021981:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1784044493.021992:0:23499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044493.022026:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581096576:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044493.022053:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044493.022069:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455e2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044493.022088:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581096576 00000100:00100000:0.0:1784044493.022094:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581096576 00000100:00100000:0.0:1784044493.022144:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784044493.022154:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+15:23499:x1870705581096576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044493.022168:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044493.022416:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19add expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.022441:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19add expref: 16 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.022452:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19add expref: 16 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.022460:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3940030e00, rc 0) 00000100:00100000:0.0:1784044493.022514:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+16:23499:x1870705581096576:12345-0@lo:101:mount.lustre.0 Request processed in 361us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044493.022527:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784044493.022707:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581096576:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044493.022723:0:23499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044493.022732:0:23499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044493.023485:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581096704:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1784044493.023655:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044493.023727:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455e2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044493.023786:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581096704 00000100:00100000:1.0:1784044493.023792:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581096704 00000100:00100000:1.0:1784044493.023868:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784044493.023876:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+16:23499:x1870705581096704:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1784044493.023894:0:22758:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784044493.023911:0:22758:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784044493.023915:0:22758:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1784044493.024013:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+16:23499:x1870705581096704:12345-0@lo:256:mount.lustre.0 Request processed in 138us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044493.024020:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784044493.024090:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581096704:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1784044493.025686:0:23499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784044493.025712:0:23499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.025725:0:23499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044493.025734:0:23499:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f3cb000 from 1 10000000:01000000:3.0:1784044493.025737:0:23499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044493.025783:0:23499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.025792:0:23499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.025811:0:23499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044493.025832:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581096832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044493.025886:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044493.026524:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d5c480 going to sleep for 11 seconds 00000100:00100000:2.0:1784044493.026724:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581096832 00000100:00100000:2.0:1784044493.026732:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581096832 00000100:00100000:2.0:1784044493.026789:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784044493.026798:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+16:23499:x1870705581096832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044493.026813:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044493.026827:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39586efa00/0x89871fc3aba19af2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19aeb expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044493.026853:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39586efa00/0x89871fc3aba19af2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19aeb expref: 17 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044493.026864:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39586efa00/0x89871fc3aba19af2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19aeb expref: 17 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044493.026889:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586efa00, rc 0) 00000100:00100000:2.0:1784044493.026941:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+17:23499:x1870705581096832:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044493.026949:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784044493.027057:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581096832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044493.027073:0:23499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.027082:0:23499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044493.028490:0:23499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1784044493.028903:0:23499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044493.029108:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1784044493.029133:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1784044493.029147:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1784044493.029163:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1784044493.029333:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1784044493.029353:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1784044493.029368:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1784044493.029383:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1784044493.029398:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1784044493.029412:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1784044493.029426:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1784044493.029444:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1784044493.029449:0:23499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1784044493.029648:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581096960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044493.029718:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044493.029823:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d5c600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044493.030105:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581096960 00000100:00100000:0.0:1784044493.030113:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581096960 00000100:00100000:2.0:1784044493.030352:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784044493.030364:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+17:23499:x1870705581096960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044493.031695:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+17:23499:x1870705581096960:12345-0@lo:501:mount.lustre.0 Request processed in 1330us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044493.031706:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784044493.031853:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581096960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044493.031902:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044493.031952:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044493.031978:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d5c600 going to sleep for 11 seconds 00000100:00100000:1.0:1784044493.032046:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581097088 00000100:00100000:1.0:1784044493.032051:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581097088 00000100:00100000:1.0:1784044493.032090:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044493.032099:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+17:23499:x1870705581097088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044493.032355:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044493.032624:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+17:23499:x1870705581097088:12345-0@lo:503:mount.lustre.0 Request processed in 122us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044493.032632:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:3.0:1784044493.032988:0:23499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044493.033072:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044493.033111:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044493.033146:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d5c480 going to sleep for 11 seconds 00000100:00100000:2.0:1784044493.033447:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581097216 00000100:00100000:2.0:1784044493.033453:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581097216 00000100:00100000:2.0:1784044493.033492:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784044493.033500:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+17:23499:x1870705581097216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044493.033680:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+17:23499:x1870705581097216:12345-0@lo:502:mount.lustre.0 Request processed in 181us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044493.033698:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044493.034051:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044493.035431:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1784044493.035474:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1784044493.035491:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1784044493.035522:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1784044493.035538:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1784044493.035623:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1784044493.035644:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1784044493.035658:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1784044493.035671:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1784044493.035684:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1784044493.035698:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1784044493.035738:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044493.035818:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044493.035866:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d5c480 going to sleep for 11 seconds 00000100:00100000:1.0:1784044493.036160:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581097344 00000100:00100000:1.0:1784044493.036167:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581097344 00000100:00100000:1.0:1784044493.036297:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044493.036306:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+17:23499:x1870705581097344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784044493.036411:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+17:23499:x1870705581097344:12345-0@lo:502:mount.lustre.0 Request processed in 106us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044493.036425:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784044493.036695:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044493.036767:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1784044493.036777:0:23499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1784044493.037719:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044493.037730:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044493.037732:0:23512:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784044493.037740:0:23512:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b396f3cb000 00000020:00000080:2.0:1784044493.037744:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044493.037753:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044493.037756:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044493.037768:0:23512:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784044493.037772:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044493.037775:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044493.037782:0:23512:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784044493.037786:0:23512:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b396f3cb000 00000020:00000080:2.0:1784044493.037788:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044493.037865:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044493.037869:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044493.037870:0:23512:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784044493.037873:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044493.037876:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044493.037877:0:23512:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784044493.037881:0:23512:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b396f3cb000 00000020:00000080:2.0:1784044493.037883:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044493.037901:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044493.037904:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044493.037906:0:23512:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784044493.037908:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044493.037911:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044493.037912:0:23512:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784044493.037916:0:23512:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b396f3cb000 00000020:00000080:2.0:1784044493.037917:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044493.037940:0:23512:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044493.037943:0:23512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044493.037944:0:23512:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784044493.037947:0:23512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1784044493.038089:0:23499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784044493.038113:0:23499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044493.038135:0:23499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044493.038147:0:23499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044493.038228:0:23499:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784044493.038232:0:23499:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b396f3cb000 10000000:01000000:1.0:1784044493.038235:0:23499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b396f3cb000 10000000:01000000:1.0:1784044493.038239:0:23499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784044493.038244:0:23499:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b396f3cb000 from 1 10000000:01000000:1.0:1784044493.038247:0:23499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784044493.038278:0:23499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb19600/0x89871fc3aba19af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044493.038287:0:23499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb19600/0x89871fc3aba19af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044493.038297:0:23499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb19600/0x89871fc3aba19af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044493.038317:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044493.038368:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044493.038396:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455d9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044493.038529:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581097472 00000100:00100000:2.0:1784044493.038535:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581097472 00000100:00100000:2.0:1784044493.038588:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784044493.038598:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+17:23499:x1870705581097472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044493.038610:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044493.038623:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39586ee600/0x89871fc3aba19b00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19af9 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044493.038656:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39586ee600/0x89871fc3aba19b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19af9 expref: 18 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044493.038674:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39586ee600/0x89871fc3aba19b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19af9 expref: 18 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044493.038683:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ee600, rc 0) 00000100:00100000:2.0:1784044493.038725:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581097472:12345-0@lo:101:mount.lustre.0 Request processed in 128us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044493.038732:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784044493.038797:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044493.038811:0:23499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb19600/0x89871fc3aba19af9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b00 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044493.038820:0:23499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb19600/0x89871fc3aba19af9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19b00 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044493.043373:0:23499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1784044493.043850:0:23499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044493.044066:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1784044493.044112:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1784044493.044129:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1784044493.044144:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1784044493.044159:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1784044493.044207:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1784044493.045754:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1784044493.045796:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1784044493.045813:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1784044493.045829:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1784044493.045845:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1784044493.045860:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1784044493.045886:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1784044493.045902:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1784044493.045916:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1784044493.045929:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1784044493.045945:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1784044493.045974:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1784044493.045990:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1784044493.046004:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1784044493.046019:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1784044493.046032:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1784044493.046047:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1784044493.046061:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1784044493.046075:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1784044493.046090:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1784044493.046106:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1784044493.046121:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1784044493.046137:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1784044493.046151:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1784044493.046164:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1784044493.046201:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1784044493.046233:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1784044493.046263:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1784044493.046279:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1784044493.046293:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1784044493.046307:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1784044493.046321:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1784044493.046335:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1784044493.046348:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1784044493.046362:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1784044493.046377:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1784044493.046393:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1784044493.046408:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1784044493.046423:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1784044493.054360:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1784044493.054381:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1784044493.054398:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1784044493.056945:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1784044493.057003:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1784044493.057032:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1784044493.057039:0:23499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1784044493.057145:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044493.057240:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044493.057289:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581097600 00000100:00100000:2.0:1784044493.057297:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581097600 00000100:00100000:2.0:1784044493.057340:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784044493.057349:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581097600:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044493.057465:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581097600:12345-0@lo:501:mount.lustre.0 Request processed in 116us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044493.057472:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784044493.057517:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394692b840 going to sleep for 11 seconds 00000100:00100000:2.0:1784044493.057538:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044493.064715:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044493.069573:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044493.069630:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394692b840 going to sleep for 11 seconds 00000100:00100000:3.0:1784044493.069805:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581097728 00000100:00100000:3.0:1784044493.069817:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581097728 00000100:00100000:3.0:1784044493.069884:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784044493.069895:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581097728:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044493.070043:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581097728:12345-0@lo:503:mount.lustre.0 Request processed in 150us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044493.070051:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784044493.072432:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097728:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784044493.072970:0:23499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784044493.073057:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044493.073125:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044493.073166:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394692ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044493.074832:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581097856 00000100:00100000:1.0:1784044493.074854:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581097856 00000100:00100000:1.0:1784044493.074929:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044493.074939:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581097856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784044493.075125:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581097856:12345-0@lo:502:mount.lustre.0 Request processed in 187us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044493.075132:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784044493.076085:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044493.076429:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1784044493.077714:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1784044493.077746:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1784044493.077780:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1784044493.077797:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1784044493.077814:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1784044493.077830:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1784044493.077862:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1784044493.077880:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1784044493.077895:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1784044493.077911:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1784044493.077927:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1784044493.077942:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1784044493.077958:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1784044493.077972:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1784044493.077988:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1784044493.078004:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1784044493.078018:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1784044493.078031:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1784044493.078046:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1784044493.078060:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1784044493.078075:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1784044493.078091:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1784044493.078122:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1784044493.078139:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1784044493.078156:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1784044493.078171:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1784044493.078206:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1784044493.080432:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1784044493.081350:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1784044493.081372:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1784044493.081399:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1784044493.081412:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1784044493.081426:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1784044493.081442:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1784044493.082327:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1784044493.082358:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1784044493.082375:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1784044493.082392:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1784044493.082424:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1784044493.082442:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1784044493.082475:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1784044493.082494:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1784044493.083866:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1784044493.083901:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1784044493.083920:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1784044493.083935:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1784044493.083951:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1784044493.084010:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044493.084090:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044493.084154:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581097984 00000100:00100000:2.0:1784044493.084161:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581097984 00000100:00100000:2.0:1784044493.084251:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784044493.084261:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581097984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044493.084373:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581097984:12345-0@lo:502:mount.lustre.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044493.084381:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784044493.084434:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394692ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044493.084470:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581097984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044493.090982:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1784044493.091046:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1784044493.091097:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581098112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044493.091193:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044493.091240:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394692ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044493.098246:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581098112 00000100:00100000:0.0:1784044493.098263:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581098112 00000100:00100000:0.0:1784044493.098345:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784044493.098357:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581098112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044493.098570:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581098112:12345-0@lo:502:mount.lustre.0 Request processed in 216us (7397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044493.098580:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784044493.099133:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581098112:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044493.099253:0:23499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1784044493.099268:0:23499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1784044493.101028:0:23517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1784044493.101048:0:23517:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9b38421119c0) 00000020:00000080:0.0:1784044493.101074:0:23517:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1784044493.101369:0:23517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b396f3cb000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1784044493.101374:0:23517:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b396f3cb000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1784044493.101377:0:23517:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b396f3cb000 3 00010000:00080000:0.0:1784044493.101412:0:23517:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b397418c800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1784044493.115022:0:23517:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1784044493.115156:0:23517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1784044493.115434:0:23517:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784044493.115448:0:23517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x89871fc3aba19b0e 00000100:00080000:0.0:1784044493.115646:0:23517:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784044493.115654:0:23517:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b397418c800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044493.115692:0:23517:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b0a80 x1870705581098240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044493.115720:0:23517:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784044493.116158:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044493.116163:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044493.116166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044493.116170:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044493.116395:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581098240:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044493.116483:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044493.116768:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581098240 00000100:00100000:2.0:1784044493.116777:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581098240 00000100:00100000:2.0:1784044493.116815:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784044493.116822:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581098240:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784044493.116874:0:22764:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:2.0:1784044493.116912:0:22764:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x89871fc3aba19b15 00000004:00100000:2.0:1784044493.116926:0:22764:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784044493.116954:0:22764:0:(import.c:65:import_set_state_nolock()) ffff9b395264c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044493.117004:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870705581098240:12345-0@lo:38:llog_process_th.0 Request processed in 180us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044493.117011:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784044493.117049:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b39503b0a80 x1870705581098240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044493.117060:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784044493.117068:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1784044493.117075:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784044493.117080:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784044493.117088:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397418c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784044493.117095:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581098240:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1784044493.118412:0:23517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1784044493.119038:0:23499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784044493.119071:0:23499:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784044493.119099:0:23499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb19600/0x89871fc3aba19af9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b00 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044493.119112:0:23499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb19600/0x89871fc3aba19af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b00 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784044493.119166:0:23499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784044493.119169:0:23499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784044493.119170:0:23499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044493.119194:0:23499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044493.119196:0:23499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044493.119197:0:23499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044493.119199:0:23499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784044493.119201:0:23499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044493.119202:0:23499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784044493.119206:0:23499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1784044493.119209:0:23499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784044493.119210:0:23499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784044493.119211:0:23499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044493.119212:0:23499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044493.119214:0:23499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044493.119215:0:23499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044493.119228:0:23499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784044493.119229:0:23499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044493.119230:0:23499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784044493.119254:0:23499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1784044493.119273:0:23499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581098368:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784044493.119338:0:23499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044493.119375:0:23499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044493.119401:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581098368 00000100:00100000:2.0:1784044493.119412:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581098368 00000100:00100000:2.0:1784044493.119469:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784044493.119479:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581098368:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784044493.119723:0:22759:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784044493.119736:0:22759:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1784044493.137254:0:22744:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1784044493.137290:0:22759:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784044493.137305:0:22759:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1784044493.137994:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:23499:x1870705581098368:12345-0@lo:253:mount.lustre.0 Request processed in 18511us (18650us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044493.138008:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784044493.138084:0:23499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:23499:1870705581098368:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784044493.138101:0:23499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784044493.138105:0:23499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784044493.138107:0:23499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784044493.138108:0:23499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044493.138109:0:23499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044493.138111:0:23499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044493.138113:0:23499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044493.138115:0:23499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784044493.138117:0:23499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044493.138118:0:23499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784044493.138133:0:23499:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1784044493.139026:0:22780:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784044493.139033:0:22780:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784044493.139057:0:22780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.139074:0:22780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3940031800/0x89871fc3aba19a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19a19 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.139082:0:22780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19add expref: 17 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.139090:0:22780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.139128:0:22780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19add expref: 17 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.139142:0:22780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ae4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19add expref: 17 pid: 22756 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044493.139157:0:22780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581098496:0@lo:104: 00000100:00100000:0.0:1784044493.141243:0:22780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044493.141311:0:22780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3940031800/0x89871fc3aba19a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19a19 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.141325:0:22780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3940031800/0x89871fc3aba19a20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19a19 expref: 17 pid: 22758 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044493.141337:0:22780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581098624:0@lo:104: 00000100:00100000:0.0:1784044493.141362:0:22780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044493.141376:0:22780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044493.141882:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581098496 00000100:00100000:3.0:1784044493.141890:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581098496 00000100:00100000:3.0:1784044493.141928:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581098624 00000100:00100000:3.0:1784044493.141932:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581098624 00000100:00100000:3.0:1784044493.141948:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044493.141957:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+4:22780:x1870705581098496:12345-0@lo:104: 00010000:00010000:3.0:1784044493.141972:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142035:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044493.142041:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+4:22780:x1870705581098496:12345-0@lo:104: Request processed in 86us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044493.142056:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044493.142073:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784044493.142080:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:22780:x1870705581098624:12345-0@lo:104: 00010000:00010000:3.0:1784044493.142087:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142122:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784044493.142127:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:22780:x1870705581098624:12345-0@lo:104: Request processed in 49us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044493.142133:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1784044493.142151:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044493.142157:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142164:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586eea00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044493.142169:0:22753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142198:0:22753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044493.142207:0:22753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044493.142212:0:22753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044493.142252:0:22753:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142259:0:22753:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044493.142286:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142294:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19add lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19ae4 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142309:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044493.142312:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142318:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044493.142321:0:22753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142327:0:22753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044493.142333:0:22753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044493.142338:0:22753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044493.142352:0:22753:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142357:0:22753:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044493.142362:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142368:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19a19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19a20 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.142392:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044493.142394:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044493.142396:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044493.142402:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044493.142419:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581098752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044493.142449:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044493.142484:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044493.142490:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581098880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044493.142923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044493.142975:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581098752 00000100:00100000:3.0:1784044493.142980:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581098752 00010000:00010000:3.0:1784044493.142999:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ae4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19add expref: 18 pid: 22756 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044493.143020:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581098880 00000100:00100000:3.0:1784044493.143023:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581098880 00010000:00010000:3.0:1784044493.143033:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3940031800/0x89871fc3aba19a20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19a19 expref: 19 pid: 22758 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044493.143045:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044493.143050:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+19:3638:x1870705581098752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044493.143060:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044493.143064:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ae4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19add expref: 19 pid: 22756 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143073:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ae4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19add expref: 19 pid: 22756 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143099:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044493.143126:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+19:3638:x1870705581098752:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044493.143132:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044493.143144:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784044493.143149:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:3638:x1870705581098880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044493.143156:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044493.143160:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3940031800/0x89871fc3aba19a20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19a19 expref: 18 pid: 22758 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143167:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3940031800/0x89871fc3aba19a20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19a19 expref: 18 pid: 22758 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143199:0:22750:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143208:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784044493.143232:0:22750:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004200242s 00010000:00010000:3.0:1784044493.143236:0:22750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143243:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143249:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143266:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143272:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3940031e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044493.143276:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143283:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143291:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044493.143301:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044493.143322:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:3638:x1870705581098880:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044493.143329:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784044493.143363:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581098880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044493.143370:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581098752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044493.144366:0:22780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ae4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19add expref: 17 pid: 22756 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044493.144382:0:22780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581098496:0@lo:104: 00010000:00010000:0.0:1784044493.144394:0:22780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940031800/0x89871fc3aba19a20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19a19 expref: 16 pid: 22758 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044493.144404:0:22780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581098624:0@lo:104: 00010000:00010000:0.0:1784044493.144421:0:22780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.144431:0:22780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.144437:0:22780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044493.144444:0:22780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940031e00/0x89871fc3aba19b1c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1784044493.164820:0:23499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1784044493.164928:0:23523:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1784044493.164933:0:23523:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1784044493.166370:0:23524:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784044493.166842:0:23499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1784044493.171382:0:23524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784044493.174267:0:23525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23525:1870705581099008:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784044493.174345:0:23525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1784044493.174431:0:23499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1784044493.175226:0:23524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784044493.175290:0:23524:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1784044493.175437:0:23499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784044493.176008:0:23499:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784044493.176017:0:23499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1784044493.176071:0:23499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044493.178152:0:23499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784044493.178850:0:23499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784044493.178884:0:23499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1784044493.179016:0:23499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784044493.179947:0:23499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:2.0:1784044493.181885:0:23499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1784044493.188767:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581099008 00000100:00100000:3.0:1784044493.188783:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581099008 00000100:00100000:3.0:1784044493.188854:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784044493.188864:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23525:x1870705581099008:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784044493.188981:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23525:x1870705581099008:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (14636us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044493.188989:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784044493.189257:0:23525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d63300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044493.189287:0:23525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23525:1870705581099008:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1784044493.189322:0:23525:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1784044493.189364:0:23525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23525:1870705581099136:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784044493.189402:0:23525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044493.189417:0:23525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39758de240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044493.189720:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581099136 00000100:00100000:3.0:1784044493.189726:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581099136 00000100:00100000:3.0:1784044493.189772:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784044493.189779:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23525:x1870705581099136:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784044493.189883:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23525:x1870705581099136:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 104us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044493.189890:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784044493.197966:0:23525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23525:1870705581099136:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784044493.198070:0:23525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23525:1870705581099264:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1784044493.198139:0:23525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044493.198186:0:23525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab49b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044493.198326:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581099264 00000100:00100000:2.0:1784044493.198334:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581099264 00000100:00100000:2.0:1784044493.198426:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784044493.198437:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23525:x1870705581099264:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1784044493.198524:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23525:x1870705581099264:12345-0@lo:900:lod0001_rec0000.0 Request processed in 89us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044493.198532:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784044493.198657:0:23525:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b39503b1f80 x1870705581099264/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784044509 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044493.198669:0:23525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23525:1870705581099264:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1784044493.198726:0:23525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23525:1870705581099392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784044493.198766:0:23525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044493.198782:0:23525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d63900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044493.199239:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581099392 00000100:00100000:3.0:1784044493.199244:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581099392 00000100:00100000:3.0:1784044493.199275:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784044493.199282:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23525:x1870705581099392:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784044493.199346:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23525:x1870705581099392:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 64us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044493.199352:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784044493.199385:0:23525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23525:1870705581099392:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1784044493.199436:0:23525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1784044493.206491:0:23499:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784044493.206541:0:23499:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb73bc152b988 00100000:10000000:0.0:1784044493.206556:0:23499:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:3.0:1784044493.208025:0:23525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784044493.208112:0:23525:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784044493.208118:0:23525:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:2.0:1784044493.224157:0:23499:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784044493.224238:0:23499:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784044493.224258:0:23499:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1784044493.224281:0:23499:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1784044493.259059:0:23499:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784044493.259367:0:23499:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784044493.325295:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044493.905390:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00000040:00080000:0.0:1784044494.229345:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044494.349854:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784044494.417818:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784044494.417828:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f3cb000 from 12 10000000:01000000:2.0:1784044494.417834:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784044494.418115:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044494.418129:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044494.418140:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044494.423666:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581099520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044494.423760:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044494.423799:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39758de600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044494.423887:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581099520 00000100:00100000:0.0:1784044494.423905:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581099520 00000100:00100000:0.0:1784044494.423960:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784044494.423971:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+16:22761:x1870705581099520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044494.423986:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044494.424006:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3940030000/0x89871fc3aba19b2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19b23 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044494.424033:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940030000/0x89871fc3aba19b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19b23 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044494.424045:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3940030000/0x89871fc3aba19b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19b23 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044494.424054:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3940030000, rc 0) 00000100:00100000:0.0:1784044494.424099:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+17:22761:x1870705581099520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044494.424107:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784044494.424137:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581099520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044494.424155:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044494.424163:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044494.424246:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581099648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784044494.424277:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044494.424390:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581099648 00000100:00100000:0.0:1784044494.424395:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581099648 00000100:00100000:1.0:1784044494.424398:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38437033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044494.424429:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784044494.424437:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+17:22761:x1870705581099648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784044494.424450:0:22759:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784044494.424465:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784044494.424468:0:22759:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1784044494.424556:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+17:22761:x1870705581099648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044494.424563:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784044494.424693:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581099648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784044494.424735:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784044494.424742:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044494.424763:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044494.424772:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784044494.424775:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b38431d5800 from 12 10000000:01000000:1.0:1784044494.424777:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784044494.424797:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044494.424805:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044494.424813:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044494.424826:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581099776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044494.424918:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044494.424980:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38437033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044494.430870:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581099776 00000100:00100000:2.0:1784044494.430885:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581099776 00000100:00100000:3.0:1784044494.436860:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784044494.436876:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+17:22761:x1870705581099776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044494.436893:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044494.436911:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982055200/0x89871fc3aba19b38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19b31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044494.436939:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982055200/0x89871fc3aba19b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19b31 expref: 18 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044494.436951:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982055200/0x89871fc3aba19b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19b31 expref: 18 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044494.436959:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982055200, rc 0) 00000100:00100000:3.0:1784044494.439966:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+18:22761:x1870705581099776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3085us (15037us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044494.439978:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784044494.440150:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581099776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044494.440193:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044494.440204:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044494.440268:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581099904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784044494.440312:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044494.440425:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38437033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044494.440830:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581099904 00000100:00100000:2.0:1784044494.440837:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581099904 00000100:00100000:2.0:1784044494.440894:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784044494.440903:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:22761:x1870705581099904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784044494.440925:0:22759:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784044494.440944:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784044494.440947:0:22759:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1784044494.441044:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:22761:x1870705581099904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044494.441053:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784044494.441159:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581099904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784044494.441303:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784044494.441311:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044494.441320:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044494.925259:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00000040:00080000:1.0:1784044495.263827:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044495.373514:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044495.949245:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:3.0:1784044496.397319:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044496.973284:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00010000:00010000:3.0:1784044497.421329:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044497.934050:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784044497.998298:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 0 seconds 00000001:02000400:2.0:1784044498.300613:0:23768:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784044498.446893:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044498.510131:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784044498.510139:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784044498.510143:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b395820b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044498.510154:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b395820b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044498.510194:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503bf480 x1870705581100160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044498.511034:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044498.511040:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044498.511042:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044498.511046:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044498.511078:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044498.511081:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044498.511084:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044498.511087:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784044498.512111:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581100032:0@lo:400:kworker.0 00000100:00100000:3.0:1784044498.514623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044498.514701:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044498.514727:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581100288:0@lo:400:kworker.0 00000100:00100000:3.0:1784044498.514786:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044498.514831:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581100160:0@lo:38:kworker.0 00000100:00100000:3.0:1784044498.514861:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044498.514896:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581100416:0@lo:400:kworker.0 00000100:00100000:3.0:1784044498.514921:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044498.514941:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044498.514948:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581100544:0@lo:400:kworker.0 00000100:00100000:3.0:1784044498.514973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044498.515007:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581100288 00000100:00100000:3.0:1784044498.515015:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581100288 00000100:00100000:3.0:1784044498.515070:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581100544 00000100:00100000:3.0:1784044498.515073:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581100544 00000100:00100000:3.0:1784044498.515088:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044498.515094:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581100288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044498.515144:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581100288:12345-0@lo:400:kworker.0 Request processed in 49us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044498.515150:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044498.515165:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044498.515170:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581100544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044498.515214:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581100544:12345-0@lo:400:kworker.0 Request processed in 43us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044498.515219:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044498.515235:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581100160 00000100:00100000:3.0:1784044498.515238:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581100160 00000100:00100000:3.0:1784044498.515248:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581100416 00000100:00100000:3.0:1784044498.515250:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581100416 00000100:00100000:3.0:1784044498.515263:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784044498.515268:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581100160:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784044498.515289:0:22769:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:3.0:1784044498.515323:0:22769:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba19b3f 00000004:00100000:3.0:1784044498.515339:0:22769:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1784044498.515345:0:22769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:3.0:1784044498.515449:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b39503bce00 x1870705581100544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044498.515465:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581100544:0@lo:400:kworker.0 00000100:00100000:0.0:1784044498.515687:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581100032 00000100:00100000:0.0:1784044498.515692:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581100032 00000100:00100000:0.0:1784044498.515744:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784044498.515750:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:3640:x1870705581100032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044498.515786:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:3640:x1870705581100032:12345-0@lo:400:kworker.0 Request processed in 37us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044498.515792:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784044498.517147:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581100672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044498.517220:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784044498.517260:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b39503be680 x1870705581100288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044498.517272:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581100288:0@lo:400:kworker.0 00000100:00100000:3.0:1784044498.517297:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581100032:0@lo:400:kworker.0 00000100:00100000:3.0:1784044498.517332:0:22770:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1784044498.517339:0:22770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1784044498.520853:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581100672 00000100:00100000:3.0:1784044498.520865:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581100672 00000100:00100000:0.0:1784044498.521480:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784044498.521494:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1870705581100416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044498.521739:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1870705581100416:12345-0@lo:400:kworker.0 Request processed in 248us (6816us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044498.521748:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784044498.521771:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784044498.521777:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581100672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044498.521799:0:23783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784044498.521835:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581100672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (4616us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044498.521841:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784044498.521940:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581100416:0@lo:400:kworker.0 00000100:00100000:3.0:1784044498.522920:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581100672:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1784044498.538878:0:22769:0:(import.c:65:import_set_state_nolock()) ffff9b3843447800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044498.538992:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1870705581100160:12345-0@lo:38:kworker.0 Request processed in 23720us (24127us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044498.539003:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1784044498.539116:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1784044498.539125:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784044498.539130:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784044498.539133:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b395820b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1784044498.539154:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000052b99c5a): req@ffff9b39503bdc00 x1870705581092864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044498.539170:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581100160:0@lo:38:kworker.0 00000100:00100000:3.0:1784044498.539250:0:22806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044498.539272:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9540 going to sleep for 11 seconds 00000100:00100000:3.0:1784044498.540723:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581092864 00000100:00100000:3.0:1784044498.540734:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581092864 00000100:00100000:3.0:1784044498.540787:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044498.540797:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22806:x1870705581092864:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784044498.540893:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22806:x1870705581092864:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 96us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044498.540906:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044498.540963:0:22806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22806:1870705581092864:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1784044498.540999:0:22806:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784044498.541037:0:22806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22806:1870705581100800:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784044498.541070:0:22806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044498.541097:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044498.541109:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581100800 00000100:00100000:3.0:1784044498.541112:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581100800 00000100:00100000:3.0:1784044498.541131:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784044498.541136:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22806:x1870705581100800:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784044498.541245:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22806:x1870705581100800:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 108us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044498.541251:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784044498.541276:0:22806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22806:1870705581100800:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784044498.544678:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581100928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044498.544890:0:22806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22806:1870705581101056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784044498.545949:0:22806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044498.546095:0:22806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044498.546128:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581101056 00000100:00100000:3.0:1784044498.546136:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581101056 00000100:00100000:3.0:1784044498.546429:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784044498.546439:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22806:x1870705581101056:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784044498.546516:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22806:x1870705581101056:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044498.546523:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784044498.546572:0:22806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22806:1870705581101056:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784044498.546625:0:22806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784044498.547061:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044498.547111:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581100928 00000100:00100000:0.0:1784044498.547116:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581100928 00000100:00100000:0.0:1784044498.547138:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044498.547144:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705581100928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044498.547168:0:23783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784044498.547729:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705581100928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 583us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044498.547737:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044498.547785:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581100928:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1784044498.552663:0:22806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784044498.553155:0:22806:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 23, retries 0 00000004:00080000:3.0:1784044498.553160:0:22806:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1784044499.460915:0:23822:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784044499.461565:0:23822:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784044499.469851:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044500.500917:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044500.558803:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044485/real 1784044485] req@ffff9b384316f100 x1870705581094016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044500 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044500.558832:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b384316f100 x1870705581094016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044500 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044500.558844:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044485/real 1784044485] req@ffff9b384316e680 x1870705581094144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044500 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044500.558855:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b384316e680 x1870705581094144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044500 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784044500.558873:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39513b8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044500.558883:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784044500.558887:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581094016:0@lo:8:kworker.0 00000100:00080000:3.0:1784044500.558893:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044500.558897:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784044500.558900:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581094144:0@lo:8:kworker.0 00000100:00080000:1.0:1784044500.559242:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044500.559246:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784044500.559249:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b39513b8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044500.559254:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:1.0:1784044500.559259:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784044500.559277:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b39513b8800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044500.559298:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b384316f480 x1870705581101440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044500.559312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044500.559320:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784044500.559322:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044500.559325:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:1.0:1784044500.559328:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784044500.559331:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3842123800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044500.559344:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b384316e300 x1870705581101568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044500.559387:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044500.559390:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044500.559392:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044500.559395:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784044500.559426:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581101184:0@lo:400:kworker.0 00000100:00100000:1.0:1784044500.559864:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044500.559903:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581101952:0@lo:400:kworker.0 00000100:00100000:1.0:1784044500.559928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044500.559951:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044500.559957:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581101312:0@lo:400:kworker.0 00000100:00100000:1.0:1784044500.559980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044500.560014:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581101440:0@lo:8:kworker.0 00000400:00000100:1.0:1784044500.560033:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581101440 offset 0 length 520: 4 00000100:00100000:1.0:1784044500.560045:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581101568:0@lo:8:kworker.0 00000400:00000100:1.0:1784044500.560059:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581101568 offset 0 length 520: 4 00000100:00100000:1.0:1784044500.560224:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581101696:0@lo:400:kworker.0 00000100:00100000:1.0:1784044500.560258:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044500.560588:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044500.560595:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581101824:0@lo:400:kworker.0 00000100:00100000:1.0:1784044500.560621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044500.560655:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581101184 00000100:00100000:1.0:1784044500.560661:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581101184 00000100:00100000:1.0:1784044500.560718:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784044500.560728:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:3638:x1870705581101184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044500.561007:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:3638:x1870705581101184:12345-0@lo:400:kworker.0 Request processed in 280us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044500.561016:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784044500.561050:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581101952 00000100:00100000:1.0:1784044500.561054:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581101952 00000100:00100000:1.0:1784044500.561087:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581101696 00000100:00100000:1.0:1784044500.561091:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581101696 00000100:00100000:1.0:1784044500.561120:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784044500.561126:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581101952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044500.561196:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581101952:12345-0@lo:400:kworker.0 Request processed in 70us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044500.561203:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784044500.561216:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044500.561222:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581101696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044500.561257:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581101696:12345-0@lo:400:kworker.0 Request processed in 35us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044500.561275:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044500.561297:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581101312 00000100:00100000:1.0:1784044500.561301:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581101312 00000100:00100000:1.0:1784044500.561333:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581101824 00000100:00100000:1.0:1784044500.561337:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581101824 00000100:00100000:1.0:1784044500.561351:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784044500.561366:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705581101312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044500.561402:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705581101312:12345-0@lo:400:kworker.0 Request processed in 45us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044500.561408:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784044500.561420:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784044500.561425:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581101824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044500.561674:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581101824:12345-0@lo:400:kworker.0 Request processed in 249us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044500.561681:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784044500.561738:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581101824:0@lo:400:kworker.0 00010000:00080000:1.0:1784044500.561763:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b384316d880 x1870705581101696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044500.562946:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581101696:0@lo:400:kworker.0 00000100:00100000:3.0:1784044500.570923:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581101184:0@lo:400:kworker.0 00010000:00080000:3.0:1784044500.570967:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b384316ed80 x1870705581101952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044500.570979:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581101952:0@lo:400:kworker.0 00000100:00100000:3.0:1784044500.571028:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581101312:0@lo:400:kworker.0 00000020:00000004:0.0:1784044500.575637:0:23872:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784044500.576138:0:23872:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784044501.518696:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784044501.652741:0:23920:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3464e0d0 20000000:00000080:0.0:1784044501.652762:0:23920:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b396ef8a800 uarg=0000000000000000 20000000:01000000:0.0:1784044501.652817:0:23920:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1784044501.652825:0:23920:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1784044501.652831:0:23920:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1784044501.653576:0:23921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1784044501.653737:0:23920:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1784044501.663218:0:23920:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784044501.663779:0:23920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044501.663802:0:23920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39586efc00/0x89871fc3aba199ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba199e8 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044501.663811:0:23920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39586efa00/0x89871fc3aba19af2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19aeb expref: 17 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044501.663820:0:23920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044501.663873:0:23920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39586efa00/0x89871fc3aba19af2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19aeb expref: 17 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044501.663890:0:23920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b39586efa00/0x89871fc3aba19af2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19aeb expref: 17 pid: 22759 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044501.663905:0:23920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23920:1870705581102080:0@lo:104: 00000100:00100000:0.0:1784044501.663977:0:23920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044501.664032:0:23920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39586efc00/0x89871fc3aba199ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba199e8 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044501.664041:0:23920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b39586efc00/0x89871fc3aba199ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba199e8 expref: 17 pid: 22758 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044501.664050:0:23920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23920:1870705581102208:0@lo:104: 00000100:00100000:0.0:1784044501.664070:0:23920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044501.664095:0:23920:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487840 going to sleep for 11 seconds 00000100:00100000:1.0:1784044501.664236:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581102080 00000100:00100000:1.0:1784044501.664244:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581102080 00000100:00100000:1.0:1784044501.664280:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581102208 00000100:00100000:1.0:1784044501.664283:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581102208 00000100:00100000:1.0:1784044501.664298:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044501.664306:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+4:23920:x1870705581102080:12345-0@lo:104: 00010000:00010000:1.0:1784044501.664318:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.664375:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044501.664387:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+4:23920:x1870705581102080:12345-0@lo:104: Request processed in 82us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044501.664396:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044501.664418:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784044501.664424:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:23920:x1870705581102208:12345-0@lo:104: 00010000:00010000:1.0:1784044501.664432:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.664463:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784044501.664468:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:23920:x1870705581102208:12345-0@lo:104: Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044501.664473:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1784044501.664567:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044501.664575:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044501.664583:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982054600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044501.664586:0:22752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044501.664595:0:22752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044501.664609:0:22752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044501.664613:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1784044501.664615:0:22752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044501.664644:0:22752:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044501.664651:0:22752:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044501.664669:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044501.664676:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba19aeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19af2 expref: -99 pid: 23499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044501.664703:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044501.664705:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1784044501.664705:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044501.664706:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044501.664716:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581102336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044501.664746:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044501.664830:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044501.664835:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044501.664841:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044501.664844:0:22753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044501.664850:0:22753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044501.664857:0:22753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044501.664862:0:22753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784044501.664878:0:22753:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044501.664883:0:22753:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044501.664898:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044501.664904:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba199e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba199ef expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044501.664922:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044501.664923:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044501.664925:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044501.664929:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044501.664930:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044501.665709:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581102464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044501.665739:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044501.665779:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581102336 00000100:00100000:1.0:1784044501.665784:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581102336 00010000:00010000:1.0:1784044501.665804:0:22751:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39586efa00/0x89871fc3aba19af2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19aeb expref: 18 pid: 22759 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044501.665826:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581102464 00000100:00100000:1.0:1784044501.665829:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581102464 00010000:00010000:1.0:1784044501.665840:0:22751:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39586efc00/0x89871fc3aba199ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba199e8 expref: 19 pid: 22758 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044501.665854:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044501.665861:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccdc2386-7f06-47a4-81d1-1145948bf326+19:3638:x1870705581102336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044501.665871:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044501.665876:0:22751:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39586efa00/0x89871fc3aba19af2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19aeb expref: 19 pid: 22759 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.665891:0:22751:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39586efa00/0x89871fc3aba19af2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19aeb expref: 19 pid: 22759 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.665906:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044501.665936:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccdc2386-7f06-47a4-81d1-1145948bf326+19:3638:x1870705581102336:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044501.665943:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044501.665956:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784044501.665962:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:3640:x1870705581102464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044501.665970:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044501.665974:0:22751:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39586efc00/0x89871fc3aba199ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba199e8 expref: 18 pid: 22758 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.665982:0:22751:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39586efc00/0x89871fc3aba199ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba199e8 expref: 18 pid: 22758 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.665994:0:22751:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.666002:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.666015:0:22751:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.666022:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.666029:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.666041:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.666047:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3940030e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044501.666051:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.666057:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.666065:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044501.666075:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044501.666103:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:3640:x1870705581102464:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044501.666108:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784044501.666141:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581102336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044501.666164:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581102464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044501.666753:0:23920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39586efa00/0x89871fc3aba19af2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19aeb expref: 17 pid: 22759 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044501.666766:0:23920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23920:1870705581102080:0@lo:104: 00010000:00010000:0.0:1784044501.666781:0:23920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39586efc00/0x89871fc3aba199ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba199e8 expref: 16 pid: 22758 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044501.666790:0:23920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23920:1870705581102208:0@lo:104: 00010000:00010000:0.0:1784044501.666807:0:23920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044501.666817:0:23920:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044501.666824:0:23920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044501.666985:0:23920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19b46 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044502.541803:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784044503.566977:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784044503.566988:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f3cb000 from 13 10000000:01000000:2.0:1784044503.566994:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044503.567047:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044503.567059:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044503.567072:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044503.567100:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581102592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044503.567205:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044503.567658:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581102592 00000100:00100000:3.0:1784044503.569125:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581102592 00000100:00100000:3.0:1784044503.569204:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784044503.569215:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+16:22761:x1870705581102592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044503.569232:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044503.570006:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7000/0x89871fc3aba19b54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19b4d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044503.570040:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7000/0x89871fc3aba19b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19b4d expref: 17 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044503.570053:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7000/0x89871fc3aba19b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19b4d expref: 17 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044503.570064:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7000, rc 0) 00000100:00100000:3.0:1784044503.570141:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+17:22761:x1870705581102592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 927us (2936us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044503.570150:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784044503.570527:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436950c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044503.570556:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581102592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044503.570574:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044503.570584:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044503.570702:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581102720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044503.570743:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044503.570777:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436950c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784044503.571523:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044503.571598:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581102720 00000100:00100000:1.0:1784044503.571606:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581102720 00000100:00100000:1.0:1784044503.571676:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784044503.571687:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+17:22761:x1870705581102720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044503.571844:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+17:22761:x1870705581102720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044503.571851:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784044503.572145:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581102720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044503.572208:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581102848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044503.572265:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044503.572297:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044503.572641:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581102848 00000100:00100000:3.0:1784044503.572646:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581102848 00000100:00100000:3.0:1784044503.572698:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784044503.572708:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+17:22761:x1870705581102848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044503.572826:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+17:22761:x1870705581102848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044503.572834:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784044503.573533:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581102848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784044503.576144:0:23994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1784044503.587039:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1784044503.587075:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784044503.587087:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044503.587100:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044503.587233:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784044503.587466:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b38431d5800 from 13 10000000:01000000:0.0:1784044503.587470:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784044503.587513:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044503.587522:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044503.587532:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044503.587556:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581102976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044503.588128:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044503.588211:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044503.589142:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581102976 00000100:00100000:3.0:1784044503.589152:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581102976 00000100:00100000:3.0:1784044503.591525:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784044503.591544:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+17:22761:x1870705581102976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044503.591562:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044503.591584:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19b62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19b5b expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044503.591614:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19b62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19b5b expref: 18 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044503.591627:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19b62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19b5b expref: 18 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044503.591636:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6a00, rc 0) 00000100:00100000:3.0:1784044503.591731:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:22761:x1870705581102976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (3604us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044503.591739:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784044503.591936:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581102976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044503.591956:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044503.591967:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044503.592056:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581103104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044503.592092:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044503.596250:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044503.596652:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581103104 00000100:00100000:2.0:1784044503.596673:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581103104 00000100:00100000:2.0:1784044503.596720:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784044503.596729:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+18:22761:x1870705581103104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044503.596886:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+18:22761:x1870705581103104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (4793us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044503.596894:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784044503.597088:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581103104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044503.597134:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581103232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044503.597206:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044503.597230:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044503.599294:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581103232 00000100:00100000:2.0:1784044503.599317:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581103232 00000100:00100000:2.0:1784044503.599375:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784044503.599385:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+18:22761:x1870705581103232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044503.599544:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+18:22761:x1870705581103232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044503.599552:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784044503.599618:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581103232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784044503.600313:0:23997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784044503.600362:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784044503.600386:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784044503.600397:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044503.600409:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044503.629249:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044493/real 1784044493] req@ffff9b39503b1500 x1870705581096448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044503 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044503.629287:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b39503b1500 x1870705581096448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044503 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044503.629299:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044493/real 1784044493] req@ffff9b384316d180 x1870705581096320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044503 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044503.629316:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b384316d180 x1870705581096320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044503 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784044503.629336:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784044503.629364:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784044503.629368:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581096448:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1784044503.629374:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39703c0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784044503.629379:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784044503.629382:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581096320:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1784044503.629747:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044503.629752:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044503.629755:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044503.629758:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044503.629782:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044503.629785:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784044503.629787:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b39703c0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044503.629792:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:0.0:1784044503.629798:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784044503.629804:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b39703c0800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044503.629824:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b1c00 x1870705581103744/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044503.629838:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044503.629841:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784044503.629843:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044503.629853:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:0.0:1784044503.629856:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784044503.629860:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b39459d2800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044503.629872:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503b1880 x1870705581103872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044503.629908:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581104000:0@lo:400:kworker.0 00000100:00100000:0.0:1784044503.629974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044503.630008:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044503.630014:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581103360:0@lo:400:kworker.0 00000100:00100000:0.0:1784044503.630039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044503.630066:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581103488:0@lo:400:kworker.0 00000100:00100000:0.0:1784044503.630092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044503.630110:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044503.630115:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581103616:0@lo:400:kworker.0 00000100:00100000:0.0:1784044503.630137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044503.630197:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581104000 00000100:00100000:0.0:1784044503.630206:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581104000 00000100:00100000:0.0:1784044503.630465:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581103488 00000100:00100000:0.0:1784044503.630470:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581103488 00000100:00100000:0.0:1784044503.630489:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044503.630497:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581104000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044503.630550:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581104000:12345-0@lo:400:kworker.0 Request processed in 52us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044503.630557:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044503.630574:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784044503.630581:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581103488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044503.630621:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581103488:12345-0@lo:400:kworker.0 Request processed in 40us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044503.630628:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784044503.630646:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581103360 00000100:00100000:0.0:1784044503.630649:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581103360 00000100:00100000:0.0:1784044503.630680:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581103616 00000100:00100000:0.0:1784044503.630683:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581103616 00000100:00100000:0.0:1784044503.630697:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044503.630702:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705581103360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044503.630733:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705581103360:12345-0@lo:400:kworker.0 Request processed in 30us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044503.630738:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044503.630750:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784044503.630756:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581103616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044503.630780:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581103616:12345-0@lo:400:kworker.0 Request processed in 24us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044503.630785:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784044503.630828:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581103616:0@lo:400:kworker.0 00010000:00080000:0.0:1784044503.630841:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b39503b3800 x1870705581103488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044503.630850:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581103488:0@lo:400:kworker.0 00000100:00100000:0.0:1784044503.630875:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581103360:0@lo:400:kworker.0 00010000:00080000:0.0:1784044503.630885:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b39503b2680 x1870705581104000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044503.630893:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581104000:0@lo:400:kworker.0 00000100:00100000:0.0:1784044503.630924:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581103744:0@lo:8:kworker.0 00000400:00000100:0.0:1784044503.630949:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581103744 offset 0 length 520: 4 00000100:00100000:0.0:1784044503.630972:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581103872:0@lo:8:kworker.0 00000400:00000100:0.0:1784044503.630990:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581103872 offset 0 length 520: 4 00000100:00100000:1.0:1784044503.631287:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044503.631295:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581104128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044503.631587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044503.631620:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581104128 00000100:00100000:1.0:1784044503.631624:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581104128 00000100:00100000:1.0:1784044503.631656:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044503.631675:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705581104128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044503.631703:0:22770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784044503.631743:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705581104128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044503.631749:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044503.631783:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581104128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044503.638646:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581104256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044503.638744:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044503.638825:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581104256 00000100:00100000:3.0:1784044503.638835:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581104256 00000100:00100000:3.0:1784044503.638897:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784044503.638907:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581104256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044503.638939:0:23783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1784044503.643821:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581104256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4901us (5063us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044503.643845:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784044503.648824:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581104256:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784044504.590065:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784044504.656029:0:23500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:0.0:1784044505.486961:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044505.614521:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044506.638598:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044507.152688:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044507.662108:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044508.687448:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044508.750252:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044508.750259:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044508.750262:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044508.750264:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044508.750279:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044508.750282:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044508.750285:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044508.750287:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784044508.750341:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccdc2386-7f06-47a4-81d1-1145948bf326:3639:1870705581104384:0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.750445:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044508.750497:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581104896:0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.750532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044508.750552:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044508.750557:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581104768:0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.750580:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044508.750605:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581104640:0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.750664:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044508.750683:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044508.750688:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581104512:0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.750720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044508.750749:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581104384 00000100:00100000:0.0:1784044508.750757:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581104384 00000100:00100000:0.0:1784044508.750802:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784044508.750811:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+18:3639:x1870705581104384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.750859:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+18:3639:x1870705581104384:12345-0@lo:400:kworker.0 Request processed in 50us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044508.750866:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784044508.750898:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581104896 00000100:00100000:0.0:1784044508.750901:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581104896 00000100:00100000:0.0:1784044508.750924:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581104640 00000100:00100000:0.0:1784044508.750927:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581104640 00000100:00100000:0.0:1784044508.750939:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784044508.750944:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581104896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.750975:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581104896:12345-0@lo:400:kworker.0 Request processed in 30us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044508.750980:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784044508.750991:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044508.750996:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581104640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.751023:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581104640:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044508.751029:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044508.751050:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581104768 00000100:00100000:0.0:1784044508.751053:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581104768 00000100:00100000:0.0:1784044508.751082:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581104512 00000100:00100000:0.0:1784044508.751085:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581104512 00000100:00100000:0.0:1784044508.751097:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784044508.751102:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581104768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.751133:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581104768:12345-0@lo:400:kworker.0 Request processed in 30us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044508.751139:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784044508.751150:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784044508.751156:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581104512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.751204:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581104512:12345-0@lo:400:kworker.0 Request processed in 48us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044508.751210:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784044508.751257:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581104512:0@lo:400:kworker.0 00010000:00080000:0.0:1784044508.751271:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3843ce7800 x1870705581104640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044508.751281:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581104640:0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.751314:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581104768:0@lo:400:kworker.0 00000100:00100000:0.0:1784044508.751322:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccdc2386-7f06-47a4-81d1-1145948bf326:3639:1870705581104384:0@lo:400:kworker.0 00010000:00080000:0.0:1784044508.751331:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3843ce7b80 x1870705581104896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044508.751339:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581104896:0@lo:400:kworker.0 00000100:00100000:1.0:1784044508.755141:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581105024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044508.755252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044508.755416:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581105024 00000100:00100000:1.0:1784044508.755425:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581105024 00000100:00100000:1.0:1784044508.755475:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044508.755485:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581105024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044508.755523:0:23783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784044508.755582:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581105024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044508.755589:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044508.755649:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581105024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044508.757837:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044508.757859:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581105152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044508.757921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044508.757979:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581105152 00000100:00100000:0.0:1784044508.757985:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581105152 00000100:00100000:0.0:1784044508.758028:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044508.758035:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581105152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044508.758072:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784044508.758118:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581105152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044508.758124:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044508.758164:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581105152:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784044509.710039:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784044509.961805:0:24270:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784044509.961809:0:24270:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1784044509.961811:0:24270:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1784044509.961923:0:24270:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b397590c800 00000020:01000004:2.0:1784044509.961941:0:24270:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1784044509.961955:0:24270:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784044509.961970:0:24270:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b3947bc99c0) 00000020:00000080:2.0:1784044509.962054:0:24270:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784044510.251944:0:24270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784044510.253105:0:24270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784044510.260472:0:24270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784044510.264876:0:24270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1784044510.270664:0:24270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784044510.275634:0:24270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1784044510.276402:0:24270:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1784044510.300858:0:24270:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784044510.302663:0:24270:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1784044510.302681:0:24270:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784044510.302699:0:24270:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x89871fc3aba19b70 00000020:01000004:0.0:1784044510.302711:0:24270:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1784044510.302734:0:24270:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784044510.302738:0:24270:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784044510.302744:0:24270:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1784044510.302750:0:24270:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1784044510.302768:0:24270:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b3842113380) 00000020:00000080:0.0:1784044510.302781:0:24270:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1784044510.304108:0:24270:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784044510.304340:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1784044510.304347:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1784044510.310101:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1784044510.310118:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1784044510.314795:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1784044510.314811:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1784044510.323737:0:24270:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784044510.323903:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1784044510.323909:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1784044510.330831:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1784044510.330849:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784044510.371056:0:24270:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044510.371538:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784044510.371545:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784044510.372926:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784044510.372936:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1784044510.375564:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784044510.375579:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1784044510.378791:0:24270:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044510.378984:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1784044510.378990:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1784044510.394960:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1784044510.394974:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1784044510.460802:0:24270:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044510.461001:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1784044510.461009:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1784044510.472593:0:24270:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1784044510.472622:0:24270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1784044510.474764:0:24270:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1784044510.474795:0:24270:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1784044510.474802:0:24270:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1784044510.498894:0:24270:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784044510.498938:0:24270:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1784044510.498942:0:24270:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784044510.498944:0:24270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784044510.498945:0:24270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784044510.498947:0:24270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784044510.498948:0:24270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784044510.498949:0:24270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784044510.498951:0:24270:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784044510.498952:0:24270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784044510.498954:0:24270:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784044510.498958:0:24270:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1784044510.498960:0:24270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784044510.498961:0:24270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784044510.498962:0:24270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784044510.498963:0:24270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784044510.498964:0:24270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784044510.498966:0:24270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784044510.498966:0:24270:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784044510.498967:0:24270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784044510.498978:0:24270:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784044510.499111:0:24270:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784044510.499133:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105280:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784044510.499229:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044510.499272:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044510.499312:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581105280 00000100:00100000:0.0:1784044510.499319:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581105280 00000100:00100000:0.0:1784044510.499375:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784044510.499385:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:24270:x1870705581105280:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784044510.499417:0:22759:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784044510.499420:0:22759:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1784044510.499424:0:22759:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784044510.499816:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+18:24270:x1870705581105280:12345-0@lo:253:mount.lustre.0 Request processed in 432us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044510.499824:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784044510.499907:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105280:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784044510.499925:0:24270:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784044510.499927:0:24270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784044510.499928:0:24270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784044510.499929:0:24270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784044510.499930:0:24270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784044510.499931:0:24270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784044510.499932:0:24270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784044510.499933:0:24270:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784044510.499935:0:24270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784044510.499936:0:24270:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784044510.499953:0:24270:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b397590c800 from lustre-OST0000 10000000:01000000:1.0:1784044510.502764:0:24270:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1784044510.502774:0:24270:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784044510.502785:0:24270:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b3970fe4d40 local copy 00010000:00010000:1.0:1784044510.502800:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044510.502984:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044510.503065:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044510.503156:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044510.508433:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581105408 00000100:00100000:0.0:1784044510.508447:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581105408 00000100:00100000:3.0:1784044510.509999:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044510.510013:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:24270:x1870705581105408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044510.510192:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:24270:x1870705581105408:12345-0@lo:501:mount.lustre.0 Request processed in 181us (7124us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044510.510201:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784044510.510376:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105408:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784044510.510400:0:24270:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784044510.510425:0:24270:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784044510.510435:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.510446:0:24270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044510.510484:0:24270:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b397590c800 10000000:01000000:1.0:1784044510.510515:0:24270:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784044510.510521:0:24270:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784044510.510524:0:24270:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784044510.510529:0:24270:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1784044510.510532:0:24270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784044510.510560:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18000/0x89871fc3aba19b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.510569:0:24270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb18000/0x89871fc3aba19b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.510580:0:24270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb18000/0x89871fc3aba19b7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044510.510612:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044510.510803:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044510.510832:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044510.510886:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581105536 00000100:00100000:3.0:1784044510.510892:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581105536 00000100:00100000:3.0:1784044510.510913:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784044510.510919:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+18:24270:x1870705581105536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044510.510928:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044510.510941:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7400/0x89871fc3aba19b85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19b7e expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044510.510964:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7400/0x89871fc3aba19b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19b7e expref: 19 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044510.510982:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7400/0x89871fc3aba19b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19b7e expref: 19 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044510.510991:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7400, rc 0) 00000100:00100000:3.0:1784044510.511029:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+19:24270:x1870705581105536:12345-0@lo:101:mount.lustre.0 Request processed in 110us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.511035:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784044510.511202:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044510.511216:0:24270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb18000/0x89871fc3aba19b7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b85 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.511226:0:24270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18000/0x89871fc3aba19b7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19b85 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044510.524089:0:24270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1784044510.524889:0:24270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784044510.528491:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1784044510.528545:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1784044510.528566:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1784044510.528581:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1784044510.528611:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1784044510.528681:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1784044510.528700:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1784044510.528711:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1784044510.528722:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1784044510.528745:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1784044510.528757:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1784044510.528767:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1784044510.528788:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1784044510.528793:0:24270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1784044510.528888:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044510.528949:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044510.528993:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044510.529252:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581105664 00000100:00100000:3.0:1784044510.529258:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581105664 00000100:00100000:3.0:1784044510.529303:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784044510.529309:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+19:24270:x1870705581105664:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044510.529452:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+19:24270:x1870705581105664:12345-0@lo:501:mount.lustre.0 Request processed in 142us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.529458:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784044510.529812:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044510.529853:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105792:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044510.529892:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044510.529959:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044510.529988:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581105792 00000100:00100000:2.0:1784044510.529996:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581105792 00000100:00100000:2.0:1784044510.530059:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784044510.530066:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+19:24270:x1870705581105792:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044510.530964:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+19:24270:x1870705581105792:12345-0@lo:503:mount.lustre.0 Request processed in 896us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044510.530973:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784044510.531042:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105792:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784044510.531507:0:24270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784044510.531578:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784044510.531631:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044510.532116:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044510.532198:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581105920 00000100:00100000:3.0:1784044510.532212:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581105920 00000100:00100000:3.0:1784044510.532244:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784044510.532253:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+19:24270:x1870705581105920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044510.533782:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+19:24270:x1870705581105920:12345-0@lo:502:mount.lustre.0 Request processed in 1525us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.533794:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784044510.533985:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581105920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784044510.534241:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1784044510.534278:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1784044510.534288:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1784044510.534296:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1784044510.534310:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1784044510.534317:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1784044510.534324:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1784044510.534331:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1784044510.534350:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1784044510.534365:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1784044510.534394:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1784044510.534409:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1784044510.534443:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784044510.534497:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044510.534526:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044510.534536:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581106048 00000100:00100000:3.0:1784044510.534542:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581106048 00000100:00100000:3.0:1784044510.534681:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784044510.534691:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+19:24270:x1870705581106048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044510.534781:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+19:24270:x1870705581106048:12345-0@lo:502:mount.lustre.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.534794:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784044510.534853:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784044510.534885:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1784044510.534891:0:24270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1784044510.536481:0:24287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784044510.536539:0:24287:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1784044510.536545:0:24287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044510.536547:0:24287:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784044510.536552:0:24287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784044510.536573:0:24287:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b38424a8000) 00000020:00000080:2.0:1784044510.536593:0:24287:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784044510.536608:0:24287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784044510.536701:0:24287:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b397590c800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784044510.536710:0:24287:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784044510.536717:0:24287:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x89871fc3aba19b93 00010000:00010000:3.0:1784044510.541826:0:24287:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1784044510.542579:0:24287:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1784044510.544628:0:24287:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1784044510.545994:0:24287:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1784044510.546007:0:24287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044510.546013:0:24287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.546016:0:24287:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1784044510.546019:0:24287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784044510.546022:0:24287:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1784044510.546024:0:24287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044510.546025:0:24287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044510.546027:0:24287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784044510.546030:0:24287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.546031:0:24287:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784044510.546034:0:24287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044510.546037:0:24287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.546038:0:24287:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784044510.546041:0:24287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784044510.546043:0:24287:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784044510.546045:0:24287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044510.546047:0:24287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.546048:0:24287:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784044510.546051:0:24287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044510.546053:0:24287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.546054:0:24287:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784044510.546058:0:24287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784044510.546081:0:24287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044510.546085:0:24287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.546086:0:24287:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784044510.546089:0:24287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1784044510.546308:0:24270:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1784044510.546350:0:24270:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784044510.546374:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18000/0x89871fc3aba19b7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b85 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.546386:0:24270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb18000/0x89871fc3aba19b7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19b85 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044510.546394:0:24270:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b397590c800 from 1 10000000:01000000:1.0:1784044510.546397:0:24270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044510.546431:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.546439:0:24270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.546462:0:24270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044510.546487:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044510.546561:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044510.546593:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044510.546885:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581106176 00000100:00100000:0.0:1784044510.546893:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581106176 00000100:00100000:0.0:1784044510.546942:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784044510.546952:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+19:24270:x1870705581106176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044510.546963:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044510.546976:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ba1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19b9a expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044510.546998:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19b9a expref: 20 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044510.547009:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19b9a expref: 20 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044510.547019:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3940030e00, rc 0) 00000100:00100000:0.0:1784044510.547067:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+20:24270:x1870705581106176:12345-0@lo:101:mount.lustre.0 Request processed in 117us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044510.547084:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784044510.547233:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044510.547247:0:24270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.547256:0:24270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044510.548769:0:24270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1784044510.549041:0:24270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044510.549458:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1784044510.549481:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1784044510.549493:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1784044510.549634:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1784044510.549648:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1784044510.549661:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1784044510.549674:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1784044510.549687:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1784044510.549699:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1784044510.549710:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1784044510.549721:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1784044510.549736:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1784044510.549740:0:24270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1784044510.549807:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044510.549859:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.549947:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420db3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044510.551873:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581106304 00000100:00100000:0.0:1784044510.551886:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581106304 00000100:00100000:0.0:1784044510.551979:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784044510.551989:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+20:24270:x1870705581106304:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044510.552378:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+20:24270:x1870705581106304:12345-0@lo:501:mount.lustre.0 Request processed in 391us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044510.552387:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784044510.552455:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044510.552515:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106432:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044510.552564:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044510.552585:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581106432 00000100:00100000:2.0:1784044510.552589:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3943259540 going to sleep for 11 seconds 00000100:00100000:0.0:1784044510.552590:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581106432 00000100:00100000:0.0:1784044510.552703:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784044510.552710:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+20:24270:x1870705581106432:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784044510.552792:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+20:24270:x1870705581106432:12345-0@lo:503:mount.lustre.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044510.552799:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784044510.552866:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106432:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784044510.553234:0:24270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784044510.553296:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106560:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044510.553321:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044510.553351:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420db240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044510.553424:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581106560 00000100:00100000:0.0:1784044510.553428:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581106560 00000100:00100000:0.0:1784044510.553459:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784044510.553466:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+20:24270:x1870705581106560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044510.553544:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+20:24270:x1870705581106560:12345-0@lo:502:mount.lustre.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044510.553551:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784044510.553574:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044510.553819:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1784044510.553844:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1784044510.553853:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1784044510.553860:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1784044510.553867:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1784044510.553874:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1784044510.553880:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1784044510.553887:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1784044510.553894:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1784044510.553900:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1784044510.553908:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1784044510.553921:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044510.553945:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044510.553961:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420db240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044510.553984:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581106688 00000100:00100000:0.0:1784044510.553988:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581106688 00000100:00100000:0.0:1784044510.554097:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784044510.554104:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+20:24270:x1870705581106688:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044510.554170:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+20:24270:x1870705581106688:12345-0@lo:502:mount.lustre.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044510.554201:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784044510.556100:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044510.556483:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1784044510.556498:0:24270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1784044510.558825:0:24291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044510.558837:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.558840:0:24291:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784044510.558847:0:24291:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b397590c800 00000020:00000080:3.0:1784044510.558850:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044510.558859:0:24291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044510.558861:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.558862:0:24291:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784044510.558865:0:24291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044510.558867:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.558868:0:24291:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784044510.558871:0:24291:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b397590c800 00000020:00000080:3.0:1784044510.558874:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044510.558977:0:24291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044510.558981:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.558987:0:24291:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784044510.558991:0:24291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044510.558993:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.558994:0:24291:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784044510.558998:0:24291:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b397590c800 00000020:00000080:3.0:1784044510.559000:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044510.559428:0:24291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044510.559432:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.559434:0:24291:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784044510.559437:0:24291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044510.559440:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.559441:0:24291:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784044510.559445:0:24291:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b397590c800 00000020:00000080:3.0:1784044510.559447:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044510.559474:0:24291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044510.559478:0:24291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044510.559479:0:24291:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784044510.559482:0:24291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1784044510.561958:0:24270:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1784044510.562007:0:24270:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784044510.562027:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.562039:0:24270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044510.562168:0:24270:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784044510.562388:0:24270:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b397590c800 10000000:01000000:3.0:1784044510.562393:0:24270:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b397590c800 10000000:01000000:3.0:1784044510.562398:0:24270:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044510.562406:0:24270:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b397590c800 from 1 10000000:01000000:3.0:1784044510.562408:0:24270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784044510.562451:0:24270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba19ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044510.562462:0:24270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba19ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044510.562473:0:24270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba19ba8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044510.562508:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044510.562572:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.562623:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341b480 going to sleep for 11 seconds 00000100:00100000:2.0:1784044510.562698:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581106816 00000100:00100000:2.0:1784044510.562705:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581106816 00000100:00100000:2.0:1784044510.562754:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784044510.562764:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+20:24270:x1870705581106816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044510.562784:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044510.562797:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39586ee200/0x89871fc3aba19baf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19ba8 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.562819:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39586ee200/0x89871fc3aba19baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19ba8 expref: 21 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.562830:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39586ee200/0x89871fc3aba19baf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19ba8 expref: 21 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.562839:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ee200, rc 0) 00000100:00100000:2.0:1784044510.562876:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581106816:12345-0@lo:101:mount.lustre.0 Request processed in 113us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044510.562883:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784044510.563011:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044510.563028:0:24270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba19ba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19baf expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044510.563038:0:24270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba19ba8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19baf expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044510.566411:0:24270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1784044510.566698:0:24270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044510.566878:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1784044510.566905:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1784044510.566933:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1784044510.566948:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1784044510.566961:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1784044510.566975:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1784044510.566988:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1784044510.567001:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1784044510.567016:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1784044510.567029:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1784044510.567043:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1784044510.567055:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1784044510.567068:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1784044510.567083:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1784044510.567094:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1784044510.567107:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1784044510.567119:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1784044510.567142:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1784044510.567169:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1784044510.567250:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1784044510.569977:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1784044510.570023:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1784044510.570038:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1784044510.570053:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1784044510.570068:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1784044510.570081:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1784044510.570093:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1784044510.570104:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1784044510.570116:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1784044510.570128:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1784044510.570140:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1784044510.570152:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1784044510.570165:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1784044510.570193:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1784044510.570236:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1784044510.570253:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1784044510.570280:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1784044510.570295:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1784044510.570309:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1784044510.570321:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1784044510.570615:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1784044510.570639:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1784044510.570655:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1784044510.570669:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1784044510.570683:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1784044510.570697:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1784044510.570709:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1784044510.570720:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1784044510.570873:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1784044510.570902:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1784044510.570926:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1784044510.570932:0:24270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1784044510.571057:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044510.571124:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.571160:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341b000 going to sleep for 11 seconds 00000100:00100000:0.0:1784044510.571564:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581106944 00000100:00100000:0.0:1784044510.571573:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581106944 00000100:00100000:0.0:1784044510.571643:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784044510.571654:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581106944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044510.571779:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581106944:12345-0@lo:501:mount.lustre.0 Request processed in 126us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044510.571788:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784044510.572086:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581106944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044510.572123:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581107072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044510.572161:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.573423:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784044510.573675:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581107072 00000100:00100000:2.0:1784044510.573682:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581107072 00000100:00100000:2.0:1784044510.574880:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784044510.574893:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581107072:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044510.575026:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581107072:12345-0@lo:503:mount.lustre.0 Request processed in 136us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044510.575033:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784044510.575135:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581107072:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784044510.575800:0:24270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044510.575882:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581107200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044510.575926:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.575955:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581107200 00000100:00100000:3.0:1784044510.575960:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581107200 00000100:00100000:3.0:1784044510.575990:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784044510.575996:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581107200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044510.576067:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581107200:12345-0@lo:502:mount.lustre.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.576074:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784044510.576116:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044510.576129:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581107200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044510.576906:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1784044510.576936:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1784044510.576952:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1784044510.576976:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1784044510.576990:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1784044510.577003:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1784044510.577016:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1784044510.577030:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1784044510.577043:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1784044510.577057:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1784044510.577072:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1784044510.577087:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1784044510.577115:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1784044510.577131:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1784044510.577144:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1784044510.577158:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1784044510.577443:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1784044510.577468:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1784044510.577483:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1784044510.577496:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1784044510.577510:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1784044510.577524:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1784044510.577538:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1784044510.577554:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1784044510.577567:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1784044510.577581:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1784044510.577594:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1784044510.577624:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1784044510.577652:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1784044510.577667:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1784044510.577680:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1784044510.577693:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1784044510.577706:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1784044510.577719:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1784044510.577732:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1784044510.577746:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1784044510.577770:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1784044510.577785:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1784044510.577799:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1784044510.577811:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1784044510.577823:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1784044510.577835:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1784044510.577849:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1784044510.577862:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1784044510.577889:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1784044510.577905:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1784044510.577920:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1784044510.577933:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1784044510.577980:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581107328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044510.578050:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.578144:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044510.578590:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581107328 00000100:00100000:2.0:1784044510.578607:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581107328 00000100:00100000:3.0:1784044510.578748:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784044510.578757:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581107328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044510.578879:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581107328:12345-0@lo:502:mount.lustre.0 Request processed in 123us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.578887:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784044510.578964:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581107328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784044510.579146:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1784044510.579170:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1784044510.579227:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581107456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784044510.579272:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044510.579540:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3842748600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044510.579588:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581107456 00000100:00100000:2.0:1784044510.579593:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581107456 00000100:00100000:2.0:1784044510.579629:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784044510.579636:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581107456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044510.579730:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581107456:12345-0@lo:502:mount.lustre.0 Request processed in 94us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044510.579742:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784044510.579819:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581107456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784044510.579861:0:24270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1784044510.579868:0:24270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1784044510.581554:0:24296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784044510.581570:0:24296:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b384304cd40) 00000020:00000080:3.0:1784044510.581594:0:24296:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1784044510.581857:0:24296:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b397590c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784044510.581862:0:24296:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b397590c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784044510.581864:0:24296:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b397590c800 3 00010000:00080000:3.0:1784044510.581891:0:24296:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3844479800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1784044510.583549:0:24296:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1784044510.583729:0:24296:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784044510.583783:0:24296:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784044510.583800:0:24296:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x89871fc3aba19bbd 00000100:00080000:3.0:1784044510.583814:0:24296:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044510.583820:0:24296:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b3844479800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044510.583859:0:24296:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39503bed80 x1870705581107584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044510.583896:0:24296:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784044510.583952:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044510.583956:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044510.583958:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044510.583962:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044510.583989:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044510.583992:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044510.583995:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044510.583997:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784044510.584033:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581107712:0@lo:400:kworker.0 00000100:00100000:3.0:1784044510.584107:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.584146:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044510.584151:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581107840:0@lo:400:kworker.0 00000100:00100000:3.0:1784044510.584194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.584240:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581107968:0@lo:400:kworker.0 00000100:00100000:3.0:1784044510.584265:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.584285:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044510.584290:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581108096:0@lo:400:kworker.0 00000100:00100000:3.0:1784044510.584318:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.584357:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581107712 00000100:00100000:3.0:1784044510.584363:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581107712 00000100:00100000:3.0:1784044510.584400:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581107968 00000100:00100000:3.0:1784044510.584403:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581107968 00000100:00100000:3.0:1784044510.584419:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784044510.584426:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581107712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044510.584427:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581107584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784044510.584458:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.584480:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581107712:12345-0@lo:400:kworker.0 Request processed in 54us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.584489:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784044510.584502:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784044510.584508:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581107968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044510.584533:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581107968:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.584539:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784044510.585844:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581107840 00000100:00100000:3.0:1784044510.585852:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581107840 00000100:00100000:3.0:1784044510.585880:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581108096 00000100:00100000:3.0:1784044510.585883:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581108096 00000100:00100000:3.0:1784044510.585891:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581107584 00000100:00100000:3.0:1784044510.585893:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581107584 00000100:00100000:3.0:1784044510.585909:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784044510.585915:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581107840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044510.585963:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581107840:12345-0@lo:400:kworker.0 Request processed in 48us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.585970:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784044510.585984:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784044510.585989:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581108096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044510.586022:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581108096:12345-0@lo:400:kworker.0 Request processed in 32us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.586028:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784044510.586038:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044510.586041:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1870705581107584:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784044510.586069:0:22766:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:3.0:1784044510.586124:0:22766:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x89871fc3aba19bc4 00000004:00100000:3.0:1784044510.586144:0:22766:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784044510.587032:0:22766:0:(import.c:65:import_set_state_nolock()) ffff9b397a9ef800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044510.587104:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870705581107584:12345-0@lo:38:llog_process_th.0 Request processed in 1059us (2643us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.587113:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784044510.587170:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b39503bed80 x1870705581107584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044510.587205:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784044510.587215:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1784044510.587224:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784044510.587230:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784044510.587233:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3844479800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784044510.587241:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581107584:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784044510.587290:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b39503be300 x1870705581108096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044510.587301:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581108096:0@lo:400:kworker.0 00000100:00100000:3.0:1784044510.587313:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581107968:0@lo:400:kworker.0 00010000:00080000:3.0:1784044510.587352:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b39503bfb80 x1870705581107840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044510.587361:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581107840:0@lo:400:kworker.0 00000100:00100000:3.0:1784044510.587372:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581107712:0@lo:400:kworker.0 00000020:01000004:2.0:1784044510.590215:0:24296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1784044510.590234:0:24296:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9b38424ab380) 00000020:00000080:2.0:1784044510.590329:0:24296:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1784044510.590542:0:24296:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b397590c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784044510.590548:0:24296:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b397590c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784044510.590551:0:24296:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b397590c800 3 00010000:00080000:2.0:1784044510.590583:0:24296:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3952666800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1784044510.592997:0:24296:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1784044510.593117:0:24296:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1784044510.602795:0:24296:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784044510.602826:0:24296:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x89871fc3aba19bd2 00000100:00080000:0.0:1784044510.602841:0:24296:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784044510.602850:0:24296:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9b3952666800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044510.602903:0:24296:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843ce7b80 x1870705581108224/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044510.602950:0:24296:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1784044510.603529:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1870705581108224:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784044510.603639:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044510.603760:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581108224 00000100:00100000:2.0:1784044510.603767:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581108224 00000100:00100000:2.0:1784044510.603808:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784044510.603816:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581108224:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784044510.603844:0:22764:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:2.0:1784044510.603903:0:22764:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x89871fc3aba19bd9 00000004:00100000:2.0:1784044510.603920:0:22764:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784044510.603952:0:22764:0:(import.c:65:import_set_state_nolock()) ffff9b3952666000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044510.604005:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870705581108224:12345-0@lo:38:llog_process_th.0 Request processed in 189us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044510.604013:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1784044510.604326:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044510.604442:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044510.604444:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044510.604447:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044510.604451:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044510.604454:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044510.604457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044510.604460:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1784044510.604706:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3843ce7b80 x1870705581108224/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044510.604717:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784044510.604725:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1784044510.604732:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784044510.604736:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784044510.604739:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3952666800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784044510.604746:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1870705581108224:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1784044510.604951:0:24296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1784044510.606043:0:24270:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784044510.606093:0:24270:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784044510.606119:0:24270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba19ba8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19baf expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.606132:0:24270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba19ba8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19baf expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784044510.606225:0:24270:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784044510.606228:0:24270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784044510.606229:0:24270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784044510.606231:0:24270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784044510.606232:0:24270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784044510.606233:0:24270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784044510.606235:0:24270:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784044510.606236:0:24270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784044510.606238:0:24270:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784044510.606243:0:24270:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1784044510.606245:0:24270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784044510.606247:0:24270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784044510.606248:0:24270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784044510.606249:0:24270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784044510.606254:0:24270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784044510.606255:0:24270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784044510.606256:0:24270:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784044510.606258:0:24270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784044510.606258:0:24270:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784044510.606285:0:24270:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784044510.606306:0:24270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581108352:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784044510.606631:0:24270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044510.606703:0:24270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab38000 going to sleep for 11 seconds 00000100:00100000:2.0:1784044510.606849:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581108352 00000100:00100000:2.0:1784044510.606857:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581108352 00000100:00100000:2.0:1784044510.606937:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784044510.606947:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581108352:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784044510.606983:0:22756:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784044510.606997:0:22756:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784044510.620767:0:22756:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784044510.620790:0:22756:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784044510.620819:0:22780:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784044510.620824:0:22780:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784044510.620860:0:22780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.620882:0:22780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3940030000/0x89871fc3aba19b2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19b23 expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.620890:0:22780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3982055200/0x89871fc3aba19b38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19b31 expref: 21 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.620898:0:22780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.620939:0:22780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3982055200/0x89871fc3aba19b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19b31 expref: 21 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.620953:0:22780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3982055200/0x89871fc3aba19b38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19b31 expref: 21 pid: 22756 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044510.620968:0:22780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581108480:0@lo:104: 00000100:00100000:1.0:1784044510.621799:0:22780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784044510.621844:0:22780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3940030000/0x89871fc3aba19b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19b23 expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.621863:0:22780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3940030000/0x89871fc3aba19b2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19b23 expref: 21 pid: 22758 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044510.621874:0:22780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581108608:0@lo:104: 00000100:00100000:2.0:1784044510.621902:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581108480 00000100:00100000:1.0:1784044510.621906:0:22780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044510.621910:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581108480 00000100:00100000:1.0:1784044510.621928:0:22780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab38e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044510.621956:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784044510.621968:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581108608 00000100:00100000:2.0:1784044510.621971:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581108608 00000100:00100000:2.0:1784044510.621990:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044510.621999:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+4:22780:x1870705581108480:12345-0@lo:104: 00010000:00010000:2.0:1784044510.622071:0:22748:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.622208:0:22748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784044510.622215:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+4:22780:x1870705581108480:12345-0@lo:104: Request processed in 218us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044510.622222:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044510.622240:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784044510.622246:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3946dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+3:22780:x1870705581108608:12345-0@lo:104: 00010000:00010000:2.0:1784044510.622255:0:22748:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.622286:0:22748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784044510.622291:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3946dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+3:22780:x1870705581108608:12345-0@lo:104: Request processed in 45us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044510.622296:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1784044510.622348:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044510.622354:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.622361:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18c00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044510.622366:0:23922:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.622380:0:23922:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044510.622387:0:23922:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044510.622393:0:23922:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784044510.622421:0:23922:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.622427:0:23922:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044510.622448:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.622456:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19b31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b38 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044510.622468:0:22780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581108480:0@lo:104: 00010000:00010000:2.0:1784044510.622470:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044510.622477:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044510.622483:0:22780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581108608:0@lo:104: 00010000:00010000:2.0:1784044510.622485:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044510.622492:0:23922:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.622500:0:23922:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044510.622508:0:23922:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.622508:0:22780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044510.622526:0:23922:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784044510.622541:0:23922:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.622546:0:23922:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044510.622553:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.622560:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586ef000/0x89871fc3aba19b23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b2a expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044510.622573:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044510.622574:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044510.622576:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044510.622583:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044510.622594:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581108736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044510.622818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044510.622848:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044510.622854:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581108864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044510.622880:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044510.622986:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+21:24270:x1870705581108352:12345-0@lo:253:mount.lustre.0 Request processed in 16040us (16355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044510.622997:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784044510.623412:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581108736 00000100:00100000:1.0:1784044510.623418:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581108736 00010000:00010000:1.0:1784044510.623444:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3982055200/0x89871fc3aba19b38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19b31 expref: 21 pid: 22756 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044510.623476:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581108864 00000100:00100000:1.0:1784044510.623480:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581108864 00010000:00010000:1.0:1784044510.623492:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3940030000/0x89871fc3aba19b2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19b23 expref: 22 pid: 22758 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044510.623504:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784044510.623510:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+22:3638:x1870705581108736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044510.623520:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044510.623525:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3982055200/0x89871fc3aba19b38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19b31 expref: 22 pid: 22756 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623534:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3982055200/0x89871fc3aba19b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19b31 expref: 22 pid: 22756 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623559:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982055200/0x89871fc3aba19b38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19b31 expref: 22 pid: 22756 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623572:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044510.623620:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+21:3638:x1870705581108736:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044510.623626:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784044510.623641:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044510.623648:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+20:3638:x1870705581108864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044510.623655:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044510.623659:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3940030000/0x89871fc3aba19b2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19b23 expref: 20 pid: 22758 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623668:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3940030000/0x89871fc3aba19b2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19b23 expref: 20 pid: 22758 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623678:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940030000/0x89871fc3aba19b2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19b23 expref: 20 pid: 22758 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623690:0:22750:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623698:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784044510.623711:0:22750:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004200242s 00010000:00010000:1.0:1784044510.623715:0:22750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623731:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623737:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623743:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623749:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044510.623753:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623760:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623782:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044510.623793:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044510.623806:0:22780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044510.623816:0:22780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044510.623821:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+19:3638:x1870705581108864:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (939us total) trans 0 rc 0/0 00010000:00010000:3.0:1784044510.623827:0:22780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba19be0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044510.623834:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044510.624992:0:24270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:24270:1870705581108352:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784044510.625265:0:24270:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784044510.625269:0:24270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784044510.625271:0:24270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784044510.625272:0:24270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784044510.625273:0:24270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784044510.625275:0:24270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784044510.625287:0:24270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784044510.625295:0:24270:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784044510.625297:0:24270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784044510.625298:0:24270:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784044510.625315:0:24270:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1784044510.626908:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581108864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044510.626927:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581108736:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1784044510.633159:0:24270:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1784044510.637712:0:24270:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1784044510.637721:0:24270:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1784044510.637762:0:24270:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784044510.637806:0:24270:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784044510.637827:0:24270:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1784044510.637856:0:24270:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1784044510.640739:0:24270:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784044510.640957:0:24270:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784044510.736271:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044511.759044:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784044511.949868:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784044511.949877:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f3cb000 from 13 10000000:01000000:3.0:1784044511.950136:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784044511.950612:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044511.950626:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044511.950639:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044511.968300:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581108992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044511.968381:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044511.968463:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044511.968672:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581108992 00000100:00100000:3.0:1784044511.968681:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581108992 00000100:00100000:3.0:1784044511.968747:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784044511.968756:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+19:22761:x1870705581108992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044511.968771:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044511.968791:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b6000/0x89871fc3aba19bee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19be7 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044511.968827:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b6000/0x89871fc3aba19bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19be7 expref: 20 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044511.968839:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b6000/0x89871fc3aba19bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19be7 expref: 20 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044511.968848:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6000, rc 0) 00000100:00100000:3.0:1784044511.968896:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+20:22761:x1870705581108992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044511.968912:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784044511.970630:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581108992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044511.970668:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044511.970679:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044511.970763:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581109120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784044511.971045:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044511.971093:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044511.971600:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581109120 00000100:00100000:3.0:1784044511.971608:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581109120 00000100:00100000:3.0:1784044511.971663:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784044511.971672:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+20:22761:x1870705581109120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784044511.971700:0:22756:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784044511.971718:0:22756:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784044511.971722:0:22756:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1784044511.971818:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+20:22761:x1870705581109120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044511.971825:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784044511.976996:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581109120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784044511.977082:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784044511.977093:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044511.977103:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044511.977113:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784044511.977115:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b38431d5800 from 13 10000000:01000000:2.0:1784044511.977118:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784044511.977148:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044511.977155:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044511.977165:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044511.977214:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581109248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044511.977265:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044511.977305:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044511.978220:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581109248 00000100:00100000:0.0:1784044511.978228:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581109248 00000100:00100000:0.0:1784044511.978274:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784044511.978283:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+20:22761:x1870705581109248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044511.978297:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044511.978315:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3940030000/0x89871fc3aba19bfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19bf5 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044511.978337:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940030000/0x89871fc3aba19bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19bf5 expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044511.978348:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3940030000/0x89871fc3aba19bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19bf5 expref: 21 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044511.978356:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3940030000, rc 0) 00000100:00100000:0.0:1784044511.978403:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+21:22761:x1870705581109248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044511.978410:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784044511.980956:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581109248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044511.980983:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044511.980995:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044511.981062:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581109376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784044511.981125:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044511.981206:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044511.981828:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581109376 00000100:00100000:0.0:1784044511.981836:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581109376 00000100:00100000:0.0:1784044511.981891:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784044511.981901:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:22761:x1870705581109376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784044511.981919:0:22759:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784044511.981934:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784044511.981936:0:22759:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1784044511.982019:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:22761:x1870705581109376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044511.982027:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784044511.984002:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581109376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784044511.984092:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784044511.984102:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044511.984112:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1784044512.064309:0:24350:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784044512.064565:0:24350:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784044512.784477:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044513.805645:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044513.869455:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581109504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044513.869522:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044513.869716:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044513.869727:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581109632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044513.869751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044513.869805:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581109504 00000100:00100000:3.0:1784044513.869812:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581109504 00000100:00100000:3.0:1784044513.869860:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581109632 00000100:00100000:3.0:1784044513.869864:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581109632 00000100:00100000:3.0:1784044513.869879:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044513.869887:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581109504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044513.869919:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1784044513.869962:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581109504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044513.869969:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044513.870005:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784044513.870011:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581109632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044513.870027:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784044513.870057:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581109632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044513.870063:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784044513.870114:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581109632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044513.870124:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581109504:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784044514.829354:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044515.726072:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044515.853425:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044515.917996:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044515.918004:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044515.918006:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044515.918009:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044515.918039:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044515.918042:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044515.918044:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044515.918047:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784044515.918086:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581109888:0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.918155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044515.918214:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581110400:0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.918239:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044515.918266:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784044515.918272:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccdc2386-7f06-47a4-81d1-1145948bf326:3639:1870705581109760:0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.918531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044515.918572:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581110272:0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.918595:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044515.918621:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581110016:0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.918640:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044515.918654:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581110528:0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.918670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044515.918679:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044515.918683:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581110144:0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.918701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044515.918729:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581109888 00000100:00100000:3.0:1784044515.918736:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581109888 00000100:00100000:3.0:1784044515.918776:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581110144 00000100:00100000:3.0:1784044515.918779:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581110144 00000100:00100000:3.0:1784044515.918795:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784044515.918804:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581109888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.918854:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581109888:12345-0@lo:400:kworker.0 Request processed in 51us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044515.918861:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784044515.918878:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784044515.918884:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581110144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.918913:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581110144:12345-0@lo:400:kworker.0 Request processed in 29us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044515.918920:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784044515.918940:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581110400 00000100:00100000:3.0:1784044515.918943:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581110400 00000100:00100000:3.0:1784044515.918985:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581110272 00000100:00100000:3.0:1784044515.918989:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581110272 00000100:00100000:3.0:1784044515.919000:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581110016 00000100:00100000:3.0:1784044515.919002:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581110016 00000100:00100000:3.0:1784044515.919011:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581110528 00000100:00100000:3.0:1784044515.919013:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581110528 00000100:00100000:3.0:1784044515.919028:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044515.919033:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581110400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.919063:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581110400:12345-0@lo:400:kworker.0 Request processed in 30us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044515.919069:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044515.919081:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784044515.919086:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581110272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.919110:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581110272:12345-0@lo:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044515.919116:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784044515.919125:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784044515.919131:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581110016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.919153:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581110016:12345-0@lo:400:kworker.0 Request processed in 23us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044515.919158:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784044515.919167:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044515.919197:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581110528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.919222:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581110528:12345-0@lo:400:kworker.0 Request processed in 50us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044515.919228:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044515.919277:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581110144:0@lo:400:kworker.0 00000100:00100000:1.0:1784044515.919548:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581109760 00000100:00100000:1.0:1784044515.919561:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581109760 00000100:00100000:1.0:1784044515.919592:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784044515.919599:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+21:3639:x1870705581109760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044515.919632:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+21:3639:x1870705581109760:12345-0@lo:400:kworker.0 Request processed in 35us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044515.919639:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1784044515.919861:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044515.919865:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784044515.920630:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397aa57100 x1870705581110016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044515.920645:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581110016:0@lo:400:kworker.0 00010000:00080000:3.0:1784044515.920655:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397aa57480 x1870705581110528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044515.920663:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581110528:0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.920704:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccdc2386-7f06-47a4-81d1-1145948bf326:3639:1870705581109760:0@lo:400:kworker.0 00010000:00080000:3.0:1784044515.920716:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397aa55180 x1870705581110272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044515.920724:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581110272:0@lo:400:kworker.0 00000100:00100000:3.0:1784044515.920735:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581109888:0@lo:400:kworker.0 00010000:00080000:3.0:1784044515.920746:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397aa55f80 x1870705581110400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044515.920753:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581110400:0@lo:400:kworker.0 00010000:00010000:3.0:1784044516.877408:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044517.398474:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044517.904469:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044518.800254:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044503/real 1784044503] req@ffff9b39503b1c00 x1870705581103744/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044518 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044518.800286:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b39503b1c00 x1870705581103744/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044518 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044518.800296:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044503/real 1784044503] req@ffff9b39503b1880 x1870705581103872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044518 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044518.800307:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b39503b1880 x1870705581103872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044518 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784044518.800339:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39703c0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044518.800357:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784044518.800361:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581103744:0@lo:8:kworker.0 00000100:00080000:1.0:1784044518.800367:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044518.800371:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784044518.800374:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581103872:0@lo:8:kworker.0 00000100:00080000:2.0:1784044518.800536:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044518.800541:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784044518.800544:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044518.800547:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784044518.800562:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044518.800566:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784044518.800569:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b39703c0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044518.800574:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 696 00000100:00100000:3.0:1784044518.800924:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581111040:0@lo:400:kworker.0 00000100:00100000:3.0:1784044518.800997:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044518.801029:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044518.801034:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581110656:0@lo:400:kworker.0 00000100:00100000:3.0:1784044518.801060:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044518.801100:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581111040 00000100:00100000:3.0:1784044518.801107:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581111040 00000100:00080000:2.0:1784044518.801287:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784044518.801296:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b39703c0800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044518.801319:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843d4e680 x1870705581111168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044518.801335:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044518.801338:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784044518.801340:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044518.801343:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 696 00000100:00080000:2.0:1784044518.801346:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784044518.801349:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b39459d2800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044518.801362:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843d4dc00 x1870705581111296/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044518.801406:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581110784:0@lo:400:kworker.0 00000100:00100000:2.0:1784044518.801435:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044518.801455:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581111552:0@lo:400:kworker.0 00000100:00100000:2.0:1784044518.801493:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044518.801514:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784044518.801520:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581110912:0@lo:400:kworker.0 00000100:00100000:2.0:1784044518.801554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044518.801570:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581111680:0@lo:400:kworker.0 00000100:00100000:3.0:1784044518.801671:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581110784 00000100:00100000:3.0:1784044518.801675:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581110784 00000100:00100000:3.0:1784044518.801697:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784044518.801705:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581111040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044518.801754:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581111040:12345-0@lo:400:kworker.0 Request processed in 49us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044518.801762:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784044518.801780:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784044518.801787:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581110784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044518.801814:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581110784:12345-0@lo:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044518.801832:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784044518.801892:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581111040:0@lo:400:kworker.0 00000100:00100000:3.0:1784044518.801904:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044518.801910:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581111424:0@lo:400:kworker.0 00000100:00100000:3.0:1784044518.801932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044518.802230:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581111168:0@lo:8:kworker.0 00000100:00100000:3.0:1784044518.802265:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044518.802286:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581111296:0@lo:8:kworker.0 00000100:00100000:3.0:1784044518.802310:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044518.802338:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581110656 00000100:00100000:3.0:1784044518.802342:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581110656 00000100:00100000:3.0:1784044518.802366:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784044518.802373:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+21:3640:x1870705581110656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044518.802408:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+21:3640:x1870705581110656:12345-0@lo:400:kworker.0 Request processed in 35us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044518.802423:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784044518.802455:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581111552 00000100:00100000:3.0:1784044518.802459:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581111552 00000100:00100000:3.0:1784044518.802485:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581110912 00000100:00100000:3.0:1784044518.802488:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581110912 00000100:00100000:3.0:1784044518.802498:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581111424 00000100:00100000:3.0:1784044518.802500:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581111424 00000100:00100000:3.0:1784044518.802512:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784044518.802518:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581111552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044518.802560:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581111552:12345-0@lo:400:kworker.0 Request processed in 42us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044518.802567:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784044518.802579:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784044518.802923:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581111168 00000100:00100000:1.0:1784044518.802927:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581111168 00000100:00100000:1.0:1784044518.802954:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581111296 00000100:00100000:1.0:1784044518.802957:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581111296 00000100:00100000:1.0:1784044518.802973:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044518.802978:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705581111168:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1784044518.803002:0:24274:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:1.0:1784044518.803027:0:24274:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba19c03 00002000:00100000:1.0:1784044518.803039:0:24274:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9b397f9b5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1784044518.803043:0:24274:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1784044518.803046:0:24274:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784044518.803516:0:24274:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1784044518.803549:0:24274:0:(import.c:65:import_set_state_nolock()) ffff9b397f9b7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044518.803687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044518.803716:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581110784:0@lo:400:kworker.0 00010000:00080000:2.0:1784044518.803728:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397f9df100 x1870705581111552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044518.803738:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581111552:0@lo:400:kworker.0 00000100:00100000:2.0:1784044518.803767:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581111680 00000100:00100000:2.0:1784044518.803770:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581111680 00000100:00100000:3.0:1784044518.804039:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581110912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044518.804076:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581110912:12345-0@lo:400:kworker.0 Request processed in 41us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044518.804098:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1870705581111168:12345-0@lo:8:kworker.0 Request processed in 1118us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044518.804105:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044518.804119:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044518.804124:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705581111296:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1784044518.804138:0:24274:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784044518.804240:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705581111296:12345-0@lo:8:kworker.0 Request processed in 115us (1929us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784044518.804246:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1784044518.804264:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044518.804267:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784044518.804288:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843d4e680 x1870705581111168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044518.804297:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784044518.804303:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1784044518.804309:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784044518.804314:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784044518.804317:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39703c0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784044518.804328:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784044518.804332:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581111168:0@lo:8:kworker.0 00000100:00080000:1.0:1784044518.804343:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044518.804346:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044518.804349:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581111296:0@lo:8:kworker.0 00000004:00080000:1.0:1784044518.804391:0:23509:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1784044518.804408:0:23509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23509:1870705581111936:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1784044518.804432:0:23509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044518.804444:0:23509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39440f0d80 going to sleep for 11 seconds 00000004:00080000:1.0:1784044518.804456:0:23508:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784044518.804514:0:23508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 711975339367ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784044518.804520:0:23508:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1784044518.804549:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044518.804557:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581111808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044518.804670:0:22765:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044518.804678:0:22765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1784044518.804691:0:22764:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044518.804697:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784044518.804703:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581111424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044518.804734:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581111424:12345-0@lo:400:kworker.0 Request processed in 31us (2801us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044518.804739:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784044518.804750:0:22764:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044518.804754:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784044518.804759:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581111680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044518.804780:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581111680:12345-0@lo:400:kworker.0 Request processed in 21us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044518.804785:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784044518.804812:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581111936 00000100:00100000:3.0:1784044518.805223:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1784044518.805253:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843d4f100 x1870705581111424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044518.805263:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581111424:0@lo:400:kworker.0 00000100:00100000:3.0:1784044518.805272:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581110656:0@lo:400:kworker.0 00010000:00080000:3.0:1784044518.805315:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843d4ce00 x1870705581110912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044518.805323:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581110912:0@lo:400:kworker.0 00010000:00080000:3.0:1784044518.805333:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397f9dc000 x1870705581111680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044518.805347:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581111680:0@lo:400:kworker.0 00000100:00100000:2.0:1784044518.805759:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581111936 00000100:00100000:3.0:1784044518.806742:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784044518.806751:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23509:x1870705581111936:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1784044518.807253:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044518.807436:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044518.807595:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581111808 00000100:00100000:2.0:1784044518.807602:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581111808 00000100:00100000:2.0:1784044518.807637:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784044518.807645:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870705581111808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044518.807664:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044518.808283:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1870705581111808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 637us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044518.808292:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784044518.808333:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b384316df80 x1870705581111808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044518.808352:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581111808:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1784044518.821378:0:23500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1784044518.836068:0:24275:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1784044518.836080:0:24275:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1784044518.837941:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23509:x1870705581111936:12345-0@lo:7:osp-pre-0-1.0 Request processed in 31183us (33499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044518.838062:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784044518.838252:0:23509:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b384316d880 x1870705581111936/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784044534 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044518.838386:0:23509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23509:1870705581111936:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1784044518.838421:0:23509:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1784044518.838465:0:23509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23509:1870705581112064:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1784044518.838511:0:23509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044518.838550:0:23509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843695180 going to sleep for 11 seconds 00000100:00100000:0.0:1784044518.838573:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581112064 00000100:00100000:0.0:1784044518.838579:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581112064 00000100:00100000:0.0:1784044518.838620:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044518.838628:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23509:x1870705581112064:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1784044518.838655:0:24274:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1784044518.838694:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23509:x1870705581112064:12345-0@lo:5:osp-pre-0-1.0 Request processed in 66us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044518.838700:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784044518.838729:0:23509:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843ce7800 x1870705581112064/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044534 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044518.838738:0:23509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23509:1870705581112064:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1784044518.838746:0:23509:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1784044518.838769:0:23509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23509:1870705581112192:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1784044518.838789:0:23509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044518.838804:0:23509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843695180 going to sleep for 11 seconds 00000100:00100000:0.0:1784044518.838815:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581112192 00000100:00100000:0.0:1784044518.839470:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581112192 00000100:00100000:0.0:1784044518.839502:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784044518.839509:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23509:x1870705581112192:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1784044518.839549:0:24275:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:3.0:1784044518.897336:0:24271:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1784044518.897358:0:24271:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1784044518.897698:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23509:x1870705581112192:12345-0@lo:5:osp-pre-0-1.0 Request processed in 58184us (58903us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1784044518.897721:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1784044518.897938:0:23509:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843ce7800 x1870705581112192/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044534 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044518.897949:0:23509:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1784044518.897965:0:23509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23509:1870705581112192:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1784044518.897980:0:23509:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1784044518.898034:0:23509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23509:1870705581112320:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1784044518.898070:0:23509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044518.898104:0:23509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39502400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044518.898542:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581112320 00000100:00100000:0.0:1784044518.898549:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581112320 00000100:00100000:0.0:1784044518.898605:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044518.898616:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23509:x1870705581112320:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1784044518.898672:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23509:x1870705581112320:12345-0@lo:900:osp-pre-0-1.0 Request processed in 59us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044518.898679:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784044518.898710:0:23509:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b39503bd880 x1870705581112320/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784044534 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044518.898720:0:23509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23509:1870705581112320:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1784044518.925772:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044518.989725:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044518.989748:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581112448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044518.989823:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044518.989872:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581112448 00000100:00100000:0.0:1784044518.989879:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581112448 00000100:00100000:0.0:1784044518.989920:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784044518.989928:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581112448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044518.990130:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784044518.990391:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581112448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 461us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044518.990398:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784044518.990444:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581112448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044518.991171:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044518.991197:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581112576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044518.991240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044518.991273:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581112576 00000100:00100000:1.0:1784044518.991277:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581112576 00000100:00100000:1.0:1784044518.991311:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784044518.991318:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581112576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044518.991341:0:22770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784044518.991645:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581112576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 327us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044518.991653:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784044518.991745:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581112576:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1784044519.769719:0:24642:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784044519.958366:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044520.846235:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044500/real 1784044500] req@ffff9b384316f480 x1870705581101440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044520 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044520.846272:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b384316f480 x1870705581101440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044520 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044520.846282:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044500/real 1784044500] req@ffff9b384316e300 x1870705581101568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044520 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044520.846294:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b384316e300 x1870705581101568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044520 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784044520.846333:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39513b8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044520.846351:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784044520.846354:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581101440:0@lo:8:kworker.0 00000100:00080000:3.0:1784044520.846359:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044520.846364:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784044520.846366:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581101568:0@lo:8:kworker.0 00000100:00080000:2.0:1784044520.847641:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044520.847647:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784044520.847650:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b39513b8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044520.847657:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 693 00000100:00080000:2.0:1784044520.847662:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784044520.847669:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b39513b8800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044520.847696:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397f9dd180 x1870705581112960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044520.847710:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044520.847713:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784044520.847715:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044520.847718:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 693 00000100:00080000:2.0:1784044520.847720:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784044520.847724:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3842123800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044520.847733:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397f9dd500 x1870705581113088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044520.847757:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044520.847760:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784044520.847762:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044520.847765:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 711 00000100:00080000:2.0:1784044520.847767:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784044520.847771:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b39459d2800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044520.847781:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397f9dca80 x1870705581113600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044520.847824:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581113216:0@lo:400:kworker.0 00000100:00100000:3.0:1784044520.847887:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581113344:0@lo:400:kworker.0 00000100:00100000:2.0:1784044520.847890:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044520.847921:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044520.847921:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581113856:0@lo:400:kworker.0 00000100:00100000:3.0:1784044520.847939:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581113984:0@lo:400:kworker.0 00000100:00100000:2.0:1784044520.847940:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044520.847958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044520.847960:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784044520.847965:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581112832:0@lo:400:kworker.0 00000100:00100000:3.0:1784044520.847973:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784044520.847978:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581112704:0@lo:400:kworker.0 00000100:00100000:2.0:1784044520.847996:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044520.847998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044520.848024:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581113472:0@lo:400:kworker.0 00000100:00100000:3.0:1784044520.848048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044520.848076:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581113216 00000100:00100000:3.0:1784044520.848083:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581113216 00000100:00100000:3.0:1784044520.848134:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581113856 00000100:00100000:3.0:1784044520.848137:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581113856 00000100:00100000:3.0:1784044520.848161:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581113984 00000100:00100000:3.0:1784044520.848163:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581113984 00000100:00100000:3.0:1784044520.848199:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784044520.848208:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581113216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044520.848252:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581113216:12345-0@lo:400:kworker.0 Request processed in 45us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044520.848269:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784044520.848287:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784044520.848293:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581113856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044520.848321:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581113856:12345-0@lo:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044520.848327:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784044520.848339:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784044520.848344:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581113984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044520.848375:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581113984:12345-0@lo:400:kworker.0 Request processed in 30us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044520.848380:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784044520.848401:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581112704 00000100:00100000:3.0:1784044520.848405:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581112704 00000100:00100000:3.0:1784044520.848429:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784044520.848436:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:3638:x1870705581112704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044520.848465:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:3638:x1870705581112704:12345-0@lo:400:kworker.0 Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044520.848471:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784044520.848500:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581112960:0@lo:8:kworker.0 00000100:00100000:3.0:1784044520.848539:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044520.848558:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581113088:0@lo:8:kworker.0 00000100:00100000:3.0:1784044520.848582:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044520.848596:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581113600:0@lo:8:kworker.0 00000100:00100000:3.0:1784044520.848613:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044520.848659:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581112704:0@lo:400:kworker.0 00010000:00080000:3.0:1784044520.848672:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397f9ded80 x1870705581113984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044520.848681:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581113984:0@lo:400:kworker.0 00000100:00080000:1.0:1784044520.848759:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044520.848763:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044520.849247:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581113472 00000100:00100000:1.0:1784044520.849252:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581113472 00000100:00100000:1.0:1784044520.849288:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581112960 00000100:00100000:1.0:1784044520.849291:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581112960 00000100:00100000:1.0:1784044520.849300:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581113088 00000100:00100000:1.0:1784044520.849302:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581113088 00000100:00100000:1.0:1784044520.849308:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581113600 00000100:00100000:1.0:1784044520.849310:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581113600 00000100:00100000:1.0:1784044520.849321:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044520.849329:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581113472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044520.849376:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581113472:12345-0@lo:400:kworker.0 Request processed in 49us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044520.849383:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044520.849397:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784044520.849410:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581112960:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1784044520.849436:0:24276:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 714 last 0 00000020:00000080:1.0:1784044520.849464:0:24276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba19c0a 00002000:00100000:1.0:1784044520.849479:0:24276:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b396ed74000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784044520.849484:0:24276:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784044520.849486:0:24276:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784044520.849576:0:24276:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784044520.849599:0:24276:0:(import.c:65:import_set_state_nolock()) ffff9b396ed74800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044520.849641:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1870705581112960:12345-0@lo:8:kworker.0 Request processed in 230us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044520.849648:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784044520.849663:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044520.849667:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581113088:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1784044520.849678:0:24276:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784044520.849704:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581113088:12345-0@lo:8:kworker.0 Request processed in 36us (1121us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784044520.849710:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044520.849723:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044520.849726:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581113600:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1784044520.849736:0:24276:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1784044520.849853:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044520.849905:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581113600:12345-0@lo:8:kworker.0 Request processed in 175us (1290us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784044520.849911:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044520.849934:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581113344 00000100:00100000:1.0:1784044520.849939:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581113344 00000100:00100000:1.0:1784044520.850014:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581112832 00000100:00100000:1.0:1784044520.850018:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581112832 00000100:00100000:2.0:1784044520.850809:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581113728:0@lo:400:kworker.0 00000100:00100000:2.0:1784044520.850863:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784044520.850902:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397f9dfb80 x1870705581113216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044520.850916:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581113216:0@lo:400:kworker.0 00010000:00080000:2.0:1784044520.850931:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397f9df800 x1870705581113856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044520.850939:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581113856:0@lo:400:kworker.0 00000100:00100000:2.0:1784044520.850971:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581113728 00000100:00100000:2.0:1784044520.850976:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581113728 00000100:00100000:2.0:1784044520.851014:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044520.851022:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581113728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044520.851067:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581113728:12345-0@lo:400:kworker.0 Request processed in 45us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044520.851074:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1784044520.851578:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397f9dd880 x1870705581113472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044520.851590:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581113472:0@lo:400:kworker.0 00000100:00100000:3.0:1784044520.853825:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784044520.853846:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581113344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044520.853956:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581113344:12345-0@lo:400:kworker.0 Request processed in 119us (6033us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044520.853964:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784044520.853990:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784044520.853997:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581112832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044520.854029:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581112832:12345-0@lo:400:kworker.0 Request processed in 34us (6032us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044520.854035:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784044520.854452:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581113344:0@lo:400:kworker.0 00010000:00080000:1.0:1784044520.859725:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397f9dd180 x1870705581112960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044520.859741:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784044520.859752:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1784044520.859761:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784044520.859766:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784044520.859770:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39513b8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784044520.859794:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784044520.859801:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581112960:0@lo:8:kworker.0 00000100:00080000:1.0:1784044520.859816:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044520.859821:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044520.859824:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581113088:0@lo:8:kworker.0 00000100:00080000:1.0:1784044520.859835:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044520.859838:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044520.859841:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581113600:0@lo:8:kworker.0 00000004:00080000:0.0:1784044520.861850:0:22788:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784044520.861955:0:22788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 714032779611ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784044520.861964:0:22788:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1784044520.862635:0:22789:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1784044520.862665:0:22789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22789:1870705581114240:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784044520.862738:0:22789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044520.862778:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df7540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044520.862796:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581114112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044520.862823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044520.862862:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581114112 00000100:00100000:2.0:1784044520.862870:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581114112 00000100:00100000:2.0:1784044520.862936:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784044520.862945:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1870705581114112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044520.862972:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784044520.862997:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581114240 00000100:00100000:3.0:1784044520.863002:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581114240 00000100:00100000:2.0:1784044520.863016:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1870705581114112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044520.863022:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044520.863025:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784044520.863030:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:22789:x1870705581114240:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1784044520.863042:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784044520.863068:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397f9df800 x1870705581114112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044520.863085:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581114112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044520.863118:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581112832:0@lo:400:kworker.0 00010000:00080000:2.0:1784044520.863131:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397f9dc700 x1870705581113728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044520.863140:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581113728:0@lo:400:kworker.0 00002000:00080000:3.0:1784044520.867867:0:24276:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1784044520.867878:0:24276:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1784044520.867884:0:24276:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000004:00080000:2.0:1784044520.883258:0:22744:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1784044520.884353:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044520.884365:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19c11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.884388:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784044520.884393:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044520.884400:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19c11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.884420:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19c11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.884444:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19c11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.884452:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19c11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.884479:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044520.884561:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044520.884567:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19c11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.884587:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044520.884591:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19c11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.884601:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19c11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.884618:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19c11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.884625:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19c11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.884643:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.884645:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.884646:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044520.885411:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044520.885418:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.885429:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784044520.885433:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044520.885437:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.885446:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.885454:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.885461:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.885488:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044520.885527:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044520.885533:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.885541:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044520.885544:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.885552:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.885569:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.885576:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.885589:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.885591:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.885592:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784044520.885950:0:24695:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784044520.886170:0:24695:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00002000:00010000:2.0:1784044520.887954:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044520.887964:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.887981:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784044520.887987:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044520.887994:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.888008:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.888019:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.888027:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.888051:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044520.888786:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044520.888794:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83239d4/0x89871fc3aba19c26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.888805:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784044520.888809:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044520.888813:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b83239d4/0x89871fc3aba19c26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.888824:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b83239d4/0x89871fc3aba19c26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.888841:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83239d4/0x89871fc3aba19c26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.888849:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b83239d4/0x89871fc3aba19c26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.888871:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784044520.888900:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044520.888908:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.888915:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586efa00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044520.888920:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.888928:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.888945:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.888952:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.888980:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044520.888984:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b83239d4/0x89871fc3aba19c26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.888990:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044520.888994:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83239d4/0x89871fc3aba19c26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.889001:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83239d4/0x89871fc3aba19c26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.889011:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b83239d4/0x89871fc3aba19c26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.889019:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b83239d4/0x89871fc3aba19c26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.889030:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.889032:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.889033:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.889115:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044520.889213:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044520.889219:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004127d14f/0x89871fc3aba19c2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.889227:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784044520.889230:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044520.889235:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004127d14f/0x89871fc3aba19c2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.889344:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004127d14f/0x89871fc3aba19c2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.889356:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004127d14f/0x89871fc3aba19c2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.889364:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004127d14f/0x89871fc3aba19c2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.889426:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044520.889998:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044520.890004:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19c34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.890016:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784044520.890020:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044520.890024:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19c34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.890034:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19c34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.890042:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19c34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.890049:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19c34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.891404:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044520.891420:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004127d14f/0x89871fc3aba19c2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.891434:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044520.891439:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004127d14f/0x89871fc3aba19c2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.891450:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004127d14f/0x89871fc3aba19c2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.891473:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004127d14f/0x89871fc3aba19c2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.891480:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004127d14f/0x89871fc3aba19c2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.891526:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044520.891530:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19c34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.891537:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044520.891539:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19c34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.891547:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19c34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.891557:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19c34 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.891563:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.891565:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.891567:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044520.893032:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784044520.893045:0:24276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19c34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.893352:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044520.894330:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044520.894340:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cdf53ba/0x89871fc3aba19c3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.894362:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784044520.894366:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044520.894374:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cdf53ba/0x89871fc3aba19c3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.894389:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cdf53ba/0x89871fc3aba19c3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.894399:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cdf53ba/0x89871fc3aba19c3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.894406:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cdf53ba/0x89871fc3aba19c3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.895154:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044520.896444:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044520.896455:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19c42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.896473:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784044520.896477:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044520.896484:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19c42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.896498:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19c42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.896532:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19c42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.896539:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19c42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.896595:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044520.896604:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cdf53ba/0x89871fc3aba19c3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.896612:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044520.896623:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cdf53ba/0x89871fc3aba19c3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.896632:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cdf53ba/0x89871fc3aba19c3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.896650:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cdf53ba/0x89871fc3aba19c3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.896657:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cdf53ba/0x89871fc3aba19c3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.896677:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044520.900467:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044520.900480:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19c42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.900484:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.900494:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044520.900498:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19c42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.900521:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19c42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.900542:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19c42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.900550:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19c42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.900580:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.900582:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.900584:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044520.901410:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044520.901422:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba19c49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.901436:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784044520.901441:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044520.901448:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba19c49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.901461:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba19c49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.901470:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba19c49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.901478:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba19c49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.901558:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044520.904069:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044520.904087:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19c50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.904107:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784044520.904112:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044520.904120:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19c50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.904135:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19c50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.904145:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19c50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.904153:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19c50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.907432:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044520.907451:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba19c49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.907465:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044520.907470:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba19c49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.907497:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba19c49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.907532:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba19c49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.907541:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba19c49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.907563:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044520.907568:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19c50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.907574:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044520.907577:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19c50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.907584:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19c50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.907593:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19c50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.907599:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.907601:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.907609:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044520.907710:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784044520.907718:0:24276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19c50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044520.913227:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044520.913243:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba19c57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.913262:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784044520.913280:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044520.913287:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba19c57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.913301:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.913303:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba19c57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.913314:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba19c57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.913322:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba19c57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.913351:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044520.913383:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044520.913390:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba19c57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.913398:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044520.913413:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba19c57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.913423:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba19c57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.913440:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba19c57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.913447:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba19c57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.913465:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.913467:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.913468:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044520.914359:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044520.914368:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19c5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914380:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784044520.914384:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044520.914389:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19c5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914400:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19c5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914410:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19c5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914425:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19c5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914448:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784044520.914745:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044520.914751:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba19c65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914760:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784044520.914763:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044520.914768:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba19c65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914777:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba19c65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914785:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba19c65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914792:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba19c65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914807:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784044520.914814:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044520.914819:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19c5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914832:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044520.914836:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19c5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914845:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19c5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914857:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19c5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914864:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19c5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914878:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044520.914881:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba19c65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914887:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044520.914890:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba19c65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914897:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba19c65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914905:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba19c65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914916:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba19c65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.914926:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.914928:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.914929:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044520.915197:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044520.915203:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19c6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.915212:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=714s v=(0 0) 00010000:00010000:0.0:1784044520.915215:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044520.915219:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19c6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.915228:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19c6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.915235:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19c6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.915254:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19c6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.915266:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044520.915450:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044520.915456:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19c6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.915469:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044520.915473:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19c6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.915480:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19c6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.915492:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19c6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.915499:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19c6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.915522:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.915524:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.915526:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.915532:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044520.917640:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044520.917655:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.917671:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784044520.917676:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044520.917683:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.917713:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.917724:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.917732:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.917858:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044520.925159:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044520.925648:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.925665:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586efa00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044520.925671:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.925683:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.925708:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.925716:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19c73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.925735:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.925737:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.925739:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044520.925879:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044520.925887:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba19c7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.925900:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784044520.925904:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044520.925912:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba19c7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.925925:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba19c7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.925935:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba19c7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.925942:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba19c7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.925966:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784044520.926925:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044520.926934:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba19c81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.926946:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784044520.926950:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044520.926955:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba19c81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.926978:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba19c81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.926988:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba19c81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.926996:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba19c81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.927021:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784044520.927355:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044520.927363:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba19c7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.927370:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044520.927375:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba19c7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.927384:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba19c7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.927400:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba19c7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.927407:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba19c7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.927431:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044520.927435:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba19c81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.927442:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044520.927446:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba19c81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.927453:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba19c81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.927464:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba19c81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.927471:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba19c81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.927483:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.927485:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.927487:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.927766:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044520.928428:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044520.928439:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19c88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.928452:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784044520.928457:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044520.928463:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19c88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.928475:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19c88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.928484:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19c88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.928515:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19c88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.928537:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044520.928729:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044520.928736:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19c88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.928744:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044520.928765:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19c88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.928774:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19c88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.928786:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19c88 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.928793:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19c88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.928808:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.928810:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.928812:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044520.929266:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044520.929272:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba19c8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.929282:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784044520.929286:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044520.929291:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba19c8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.929300:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba19c8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.929308:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba19c8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.929315:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba19c8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.929332:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044520.935581:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044520.935600:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba19c8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.935616:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044520.935622:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba19c8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.935635:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba19c8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.935661:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba19c8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.935678:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba19c8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.935704:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.935706:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.935707:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044520.937102:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044520.937115:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.937130:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784044520.937136:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044520.937143:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.937158:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.937169:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.937202:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.937223:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044520.937661:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044520.937668:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.937684:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044520.937688:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.937697:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.937712:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.937719:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19c96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.937737:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.937739:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.937740:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044520.938840:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044520.938851:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053671bb4/0x89871fc3aba19c9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.938865:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784044520.938869:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044520.938875:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053671bb4/0x89871fc3aba19c9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.938887:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053671bb4/0x89871fc3aba19c9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.938903:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053671bb4/0x89871fc3aba19c9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.938910:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053671bb4/0x89871fc3aba19c9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.938933:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784044520.939341:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044520.939347:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba19ca4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.939356:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784044520.939359:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044520.939364:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba19ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.939373:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba19ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.939381:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba19ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.939388:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba19ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.939417:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784044520.939742:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044520.939764:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053671bb4/0x89871fc3aba19c9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.939773:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044520.939777:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053671bb4/0x89871fc3aba19c9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.939786:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053671bb4/0x89871fc3aba19c9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.939801:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053671bb4/0x89871fc3aba19c9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.939810:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053671bb4/0x89871fc3aba19c9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.939828:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044520.939832:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba19ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.939838:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044520.939841:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba19ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.939848:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba19ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.939869:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba19ca4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.939876:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba19ca4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.939889:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.939891:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.939893:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044520.940231:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044520.940238:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba19cab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.940258:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784044520.940262:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044520.940266:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba19cab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.940276:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba19cab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.940284:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba19cab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.940290:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba19cab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.940308:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044520.940623:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044520.940630:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba19cab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.940645:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044520.940648:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba19cab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.940657:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba19cab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.940669:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba19cab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.940676:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba19cab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.940691:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044520.940693:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044520.940694:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044520.940889:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044520.940896:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19cb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.940905:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784044520.940908:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044520.940913:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.940922:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.940935:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.940943:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.940964:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044520.941285:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044520.941292:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.941299:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044520.941303:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.941311:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.941322:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19cb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.941329:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ba36c5/0x89871fc3aba19cb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.941354:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.941356:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.941357:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.941486:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044520.941634:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044520.941641:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19cb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.941650:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784044520.941653:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044520.941658:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.941667:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.941675:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.941683:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.941714:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044520.942145:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044520.942152:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19cc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.942162:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=714s v=(0 0) 00010000:00010000:1.0:1784044520.942166:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044520.942170:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.942207:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.942215:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.942222:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044520.942239:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784044520.946896:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044520.946910:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.946927:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044520.946939:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.946951:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.946972:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19cb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.946980:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba19cb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.947000:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044520.947004:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.947010:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044520.947013:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.947021:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19cc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.947030:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19cc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.947037:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19cc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.947056:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.947058:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.947060:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044520.947202:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044520.950042:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044520.950055:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e1a51dc/0x89871fc3aba19cc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.950072:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784044520.950077:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044520.950084:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e1a51dc/0x89871fc3aba19cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.950100:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e1a51dc/0x89871fc3aba19cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.950110:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e1a51dc/0x89871fc3aba19cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.950117:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e1a51dc/0x89871fc3aba19cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.950143:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044520.950299:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044520.950307:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e1a51dc/0x89871fc3aba19cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.950315:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044520.950319:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e1a51dc/0x89871fc3aba19cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.950337:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e1a51dc/0x89871fc3aba19cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.950353:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e1a51dc/0x89871fc3aba19cc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.950361:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e1a51dc/0x89871fc3aba19cc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.950379:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.950381:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.950382:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044520.951028:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044520.951036:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008362c6a2/0x89871fc3aba19cce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.951058:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=714s v=(0 0) 00010000:00010000:3.0:1784044520.951062:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044520.951067:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008362c6a2/0x89871fc3aba19cce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.951077:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008362c6a2/0x89871fc3aba19cce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.951086:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008362c6a2/0x89871fc3aba19cce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.951093:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008362c6a2/0x89871fc3aba19cce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.951118:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044520.951156:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044520.951161:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008362c6a2/0x89871fc3aba19cce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.951169:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044520.951200:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008362c6a2/0x89871fc3aba19cce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.951209:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008362c6a2/0x89871fc3aba19cce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.951221:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008362c6a2/0x89871fc3aba19cce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.951238:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008362c6a2/0x89871fc3aba19cce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.951253:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.951255:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.951256:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044520.954423:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044520.954439:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19cd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.954460:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784044520.954465:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044520.954472:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.954487:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.954497:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.954516:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.954541:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044520.955055:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044520.955061:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.955067:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044520.955071:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.955079:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.955111:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19cd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.955119:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050e869a7/0x89871fc3aba19cd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.955137:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.955140:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.955142:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044520.955986:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044520.955995:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19cdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.956017:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784044520.956021:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044520.956026:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19cdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.956036:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19cdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.956045:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19cdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.956052:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19cdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.956069:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044520.957388:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044520.957399:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19cdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.957479:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044520.957483:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19cdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.957493:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19cdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.957521:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19cdc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.957529:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017dbd489/0x89871fc3aba19cdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.957546:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.957548:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.957550:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044520.961306:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044520.961322:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19ce3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.961339:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784044520.961344:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044520.961350:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.961365:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.961393:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.961400:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.961420:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044520.962266:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044520.962276:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.962286:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586efa00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044520.962291:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.962301:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.962325:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19ce3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.962335:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a97049e2/0x89871fc3aba19ce3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044520.962354:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.962356:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044520.962357:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044520.962935:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044520.962941:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df0549f2/0x89871fc3aba19cea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.962950:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1784044520.962953:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044520.962957:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df0549f2/0x89871fc3aba19cea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.962965:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df0549f2/0x89871fc3aba19cea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.962971:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df0549f2/0x89871fc3aba19cea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.962975:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df0549f2/0x89871fc3aba19cea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044520.963002:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1784044520.964440:0:24276:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1784044520.964594:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22789:x1870705581114240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 101559us (101852us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044520.964605:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1784044520.965378:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044520.965389:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df0549f2/0x89871fc3aba19cea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.965403:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044520.965408:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0549f2/0x89871fc3aba19cea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.965419:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df0549f2/0x89871fc3aba19cea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.965440:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df0549f2/0x89871fc3aba19cea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.965448:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df0549f2/0x89871fc3aba19cea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044520.965484:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.965486:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044520.965488:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044520.967391:0:22789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22789:1870705581114240:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784044520.967411:0:22789:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1784044520.967462:0:22789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22789:1870705581114368:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784044520.967532:0:22789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044520.970133:0:22789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39465a9300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044520.970421:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581114368 00000100:00100000:2.0:1784044520.970431:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581114368 00000100:00100000:3.0:1784044520.970648:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784044520.970659:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22789:x1870705581114368:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784044520.970709:0:24275:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1784044520.975715:0:24271:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1784044520.975873:0:24271:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784044520.976389:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22789:x1870705581114368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5727us (8851us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1784044520.976401:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1784044520.976854:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044520.977271:0:22789:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1784044520.977281:0:22789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22789:1870705581114368:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784044520.977297:0:22789:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:0.0:1784044521.998631:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784044522.046946:0:24745:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784044522.047727:0:24745:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784044523.023526:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044524.045539:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044524.112782:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581114496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044524.112861:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044524.112923:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581114496 00000100:00100000:2.0:1784044524.112931:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581114496 00000100:00100000:2.0:1784044524.112999:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784044524.113008:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581114496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044524.113037:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044524.113082:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581114496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044524.113089:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1784044524.113112:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044524.113149:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581114496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044524.114530:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044524.114548:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581114752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044524.114771:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044524.114855:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581114624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044524.115549:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044524.118556:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581114624 00000100:00100000:3.0:1784044524.118573:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581114624 00000100:00100000:1.0:1784044524.118642:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581114752 00000100:00100000:1.0:1784044524.118647:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581114752 00000100:00100000:1.0:1784044524.118898:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784044524.118910:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581114752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044524.118962:0:23783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1784044524.119048:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581114752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044524.119056:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784044524.119218:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784044524.119227:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581114624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044524.119253:0:22770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784044524.119294:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581114624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044524.119300:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784044524.119691:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581114752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044524.120319:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581114624:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784044525.069643:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044525.972826:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784044526.107098:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044526.157529:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581114880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044526.157603:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044526.157641:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044526.157646:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784044526.157649:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044526.157654:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 714 00000100:00080000:1.0:1784044526.157658:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784044526.157665:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3842123800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044526.157685:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b384316f480 x1870705581115264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044526.157729:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044526.157733:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784044526.157734:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044526.157738:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 714 00000100:00080000:1.0:1784044526.157740:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784044526.157757:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b39459d2800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044526.157770:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3975b7ea00 x1870705581115776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044526.157803:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581114880 00000100:00100000:1.0:1784044526.157806:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581115392:0@lo:400:kworker.0 00000100:00100000:0.0:1784044526.157811:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581114880 00000100:00100000:0.0:1784044526.157855:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044526.157863:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581114880:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044526.157877:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1784044526.157890:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044526.157894:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581116032:0@lo:400:kworker.0 00000100:00100000:1.0:1784044526.157913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044526.157926:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581114880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044526.157933:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044526.157945:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784044526.157950:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581115520:0@lo:400:kworker.0 00000100:00100000:1.0:1784044526.157975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044526.157992:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581115264:0@lo:8:kworker.0 00000100:00100000:1.0:1784044526.157997:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581116160:0@lo:400:kworker.0 00000100:00100000:3.0:1784044526.158018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044526.158018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044526.158033:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581115776:0@lo:8:kworker.0 00000100:00100000:1.0:1784044526.158041:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581115008:0@lo:400:kworker.0 00000100:00100000:3.0:1784044526.158052:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044526.158064:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044526.158083:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581115648:0@lo:400:kworker.0 00000100:00100000:1.0:1784044526.158106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044526.158113:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581115520 00000100:00100000:0.0:1784044526.158117:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581115520 00000100:00100000:1.0:1784044526.158130:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784044526.158136:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581115136:0@lo:400:kworker.0 00000100:00100000:0.0:1784044526.158154:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784044526.158156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044526.158160:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581115520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044526.158189:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581115904:0@lo:400:kworker.0 00000100:00100000:1.0:1784044526.158211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044526.158225:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581115520:12345-0@lo:400:kworker.0 Request processed in 66us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044526.158232:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784044526.158242:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581115136 00000100:00100000:0.0:1784044526.158245:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581115136 00000100:00100000:1.0:1784044526.158248:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581115392 00000100:00100000:1.0:1784044526.158250:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581115392 00000100:00100000:0.0:1784044526.158258:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784044526.158262:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581115136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044526.158266:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581116032 00000100:00100000:1.0:1784044526.158268:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581116032 00000100:00100000:1.0:1784044526.158290:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581116160 00000100:00100000:1.0:1784044526.158293:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581116160 00000100:00100000:0.0:1784044526.158294:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581115136:12345-0@lo:400:kworker.0 Request processed in 31us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044526.158304:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581115904 00000100:00100000:1.0:1784044526.158306:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581115904 00000100:00100000:0.0:1784044526.158308:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044526.158317:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044526.158322:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581115392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044526.158350:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581115392:12345-0@lo:400:kworker.0 Request processed in 28us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044526.158357:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044526.158369:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044526.158375:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581116032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044526.158382:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581115264 00000100:00100000:3.0:1784044526.158385:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581115264 00000100:00100000:3.0:1784044526.158399:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581115776 00000100:00100000:1.0:1784044526.158400:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581116032:12345-0@lo:400:kworker.0 Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044526.158401:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581115776 00000100:00100000:1.0:1784044526.158406:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784044526.158415:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581115648 00000100:00100000:1.0:1784044526.158415:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784044526.158417:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581115648 00000100:00100000:1.0:1784044526.158420:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581116160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044526.158434:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044526.158440:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581115648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044526.158443:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581116160:12345-0@lo:400:kworker.0 Request processed in 23us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044526.158448:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784044526.158470:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784044526.158476:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581115904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044526.158477:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581115648:12345-0@lo:400:kworker.0 Request processed in 38us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044526.158483:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044526.158495:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784044526.158500:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581115264:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1784044526.158500:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581115904:12345-0@lo:400:kworker.0 Request processed in 24us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044526.158505:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00020000:3.0:1784044526.158516:0:24275:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784044526.158528:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581115008 00000100:00100000:1.0:1784044526.158531:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581115008 00000100:00100000:3.0:1784044526.158555:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581115264:12345-0@lo:8:kworker.0 Request processed in 54us (535us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784044526.158555:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784044526.158561:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784044526.158566:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+21:3640:x1870705581115008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044526.158570:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784044526.158574:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581115776:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784044526.158583:0:24275:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784044526.158593:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+21:3640:x1870705581115008:12345-0@lo:400:kworker.0 Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044526.158599:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784044526.158600:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581115776:12345-0@lo:8:kworker.0 Request processed in 25us (546us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784044526.158605:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044526.158651:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581114880:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784044526.158668:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044526.158672:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784044526.158676:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581115264:0@lo:8:kworker.0 00000100:00100000:1.0:1784044526.158679:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581115136:0@lo:400:kworker.0 00000100:00080000:0.0:1784044526.158683:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044526.158685:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00010000:00080000:1.0:1784044526.158688:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3975b7e300 x1870705581115904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044526.158688:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581115776:0@lo:8:kworker.0 00000100:00100000:1.0:1784044526.158697:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581115904:0@lo:400:kworker.0 00000100:00100000:1.0:1784044526.158705:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581115008:0@lo:400:kworker.0 00000100:00100000:1.0:1784044526.158713:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581115648:0@lo:400:kworker.0 00000100:00100000:1.0:1784044526.158736:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581115520:0@lo:400:kworker.0 00010000:00080000:1.0:1784044526.158744:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3975b7ca80 x1870705581116160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044526.158751:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581116160:0@lo:400:kworker.0 00010000:00080000:1.0:1784044526.158759:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b384316d880 x1870705581115392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044526.158766:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581115392:0@lo:400:kworker.0 00010000:00080000:1.0:1784044526.158775:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3975b7fb80 x1870705581116032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044526.158782:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581116032:0@lo:400:kworker.0 00000100:00080000:2.0:1784044526.159166:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044526.159171:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044526.159199:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784044527.130893:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044527.630455:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784044528.143219:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044529.167465:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044529.231230:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581116288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044529.231303:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044529.231353:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044529.231360:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581116416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044529.231385:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044529.231416:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581116288 00000100:00100000:0.0:1784044529.231422:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581116288 00000100:00100000:0.0:1784044529.231478:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784044529.231487:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581116288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044529.231520:0:23783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784044529.231573:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581116288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044529.231580:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784044529.231601:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581116416 00000100:00100000:0.0:1784044529.231604:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581116416 00000100:00100000:0.0:1784044529.231636:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784044529.231642:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581116416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044529.231671:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784044529.231702:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581116416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044529.231708:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784044529.231749:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581116416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044529.231760:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581116288:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784044529.236048:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044529.241287:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044529.241316:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581116544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044529.241393:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044529.243315:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581116544 00000100:00100000:0.0:1784044529.243327:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581116544 00000100:00100000:0.0:1784044529.243395:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784044529.243406:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581116544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044529.243459:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784044529.243556:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581116544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (2162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044529.243564:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784044529.246387:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581116544:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1784044529.755502:0:25090:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784044529.755506:0:25090:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1784044529.755508:0:25090:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1784044529.755749:0:25090:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b3952664800 00000020:01000004:2.0:1784044529.755764:0:25090:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1784044529.755779:0:25090:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784044529.755792:0:25090:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b38424a99c0) 00000020:00000080:2.0:1784044529.755944:0:25090:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784044529.841101:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784044529.853037:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784044529.854279:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1784044529.854803:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1784044529.855195:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784044529.856510:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1784044529.856927:0:25090:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1784044529.863648:0:25090:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784044529.864739:0:25090:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1784044529.864755:0:25090:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784044529.864770:0:25090:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x89871fc3aba19cf8 00000020:01000004:1.0:1784044529.864777:0:25090:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1784044529.864872:0:25090:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784044529.864876:0:25090:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784044529.864884:0:25090:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1784044529.864921:0:25090:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1784044529.864926:0:25090:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1784044529.886236:0:25090:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784044529.886290:0:25090:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1784044529.886295:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784044529.886298:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784044529.886299:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784044529.886301:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784044529.886302:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784044529.886303:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784044529.886305:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784044529.886307:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784044529.886308:0:25090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784044529.886543:0:25090:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1784044529.886547:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784044529.886549:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784044529.886550:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784044529.886551:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784044529.886552:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784044529.886553:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784044529.886561:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784044529.886562:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784044529.886563:0:25090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784044529.886589:0:25090:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784044529.886610:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581116672:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784044529.886679:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044529.886789:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044529.891112:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581116672 00000100:00100000:3.0:1784044529.891127:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581116672 00000100:00100000:3.0:1784044529.891217:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784044529.891228:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+21:25090:x1870705581116672:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784044529.891277:0:22758:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784044529.891294:0:22758:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1784044529.891299:0:22758:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1784044529.892210:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+21:25090:x1870705581116672:12345-0@lo:253:mount.lustre.0 Request processed in 949us (5495us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044529.892221:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784044529.892777:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581116672:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784044529.892807:0:25090:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784044529.892811:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784044529.892813:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784044529.892814:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784044529.892815:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784044529.892816:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784044529.892817:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784044529.892819:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784044529.892820:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784044529.892822:0:25090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784044529.892849:0:25090:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b3952664800 from lustre-OST0001 10000000:01000000:1.0:1784044529.892881:0:25090:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1784044529.892884:0:25090:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784044529.892893:0:25090:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b3970fe4d40 local copy 00010000:00010000:1.0:1784044529.892906:0:25090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044529.893007:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581116800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044529.893049:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044529.893091:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a34e240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044529.893593:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581116800 00000100:00100000:3.0:1784044529.893600:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581116800 00000100:00100000:3.0:1784044529.893646:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784044529.893655:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:25090:x1870705581116800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044529.893742:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:25090:x1870705581116800:12345-0@lo:501:mount.lustre.0 Request processed in 89us (693us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044529.893749:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784044529.894371:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581116800:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784044529.894392:0:25090:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784044529.894421:0:25090:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784044529.894440:0:25090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044529.895364:0:25090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982054c00/0x89871fc3aba1992b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19932 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044529.895407:0:25090:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b3952664800 10000000:01000000:2.0:1784044529.895414:0:25090:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784044529.895420:0:25090:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784044529.895433:0:25090:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784044529.895438:0:25090:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1784044529.895518:0:25090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784044529.895548:0:25090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba19cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044529.895557:0:25090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba19cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044529.895567:0:25090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba19cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044529.895597:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581116928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044529.895646:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044529.895691:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a8816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044529.895910:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581116928 00000100:00100000:3.0:1784044529.895916:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581116928 00000100:00100000:3.0:1784044529.895998:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784044529.896006:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+21:25090:x1870705581116928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044529.896018:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044529.896030:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba19d06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19cff expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044529.896054:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba19d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19cff expref: 22 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044529.896065:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba19d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19cff expref: 22 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044529.896088:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6c00, rc 0) 00000100:00100000:3.0:1784044529.896141:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+22:25090:x1870705581116928:12345-0@lo:101:mount.lustre.0 Request processed in 136us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044529.896157:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784044529.896571:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581116928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044529.896587:0:25090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba19cff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d06 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044529.896597:0:25090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba19cff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19d06 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044529.915728:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1784044529.921527:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044529.928550:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1784044529.928607:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1784044529.928624:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1784044529.928637:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1784044529.928649:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1784044529.928661:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1784044529.928677:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1784044529.928689:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1784044529.928709:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1784044529.928732:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1784044529.928736:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1784044529.928849:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044529.928920:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044529.929063:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044529.934326:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581117056 00000100:00100000:1.0:1784044529.934342:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581117056 00000100:00100000:1.0:1784044529.934418:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784044529.934439:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+22:25090:x1870705581117056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044529.934808:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+22:25090:x1870705581117056:12345-0@lo:501:mount.lustre.0 Request processed in 357us (5873us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044529.934818:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784044529.936433:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044529.936497:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044529.936567:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044529.936613:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044529.936907:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581117184 00000100:00100000:3.0:1784044529.936915:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581117184 00000100:00100000:3.0:1784044529.936982:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784044529.936992:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+22:25090:x1870705581117184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044529.937991:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+22:25090:x1870705581117184:12345-0@lo:503:mount.lustre.0 Request processed in 996us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044529.938002:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784044529.940273:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117184:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784044529.940816:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784044529.940927:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044529.941006:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044529.941053:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a8816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044529.941213:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581117312 00000100:00100000:3.0:1784044529.941222:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581117312 00000100:00100000:3.0:1784044529.941287:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784044529.941298:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+22:25090:x1870705581117312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044529.943038:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+22:25090:x1870705581117312:12345-0@lo:502:mount.lustre.0 Request processed in 1734us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044529.943052:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784044529.943109:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044529.943380:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1784044529.943412:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1784044529.943444:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1784044529.943460:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1784044529.943475:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1784044529.943488:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1784044529.943508:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1784044529.943523:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1784044529.943537:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1784044529.943571:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044529.943616:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044529.943712:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a8816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044529.943898:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581117440 00000100:00100000:3.0:1784044529.943905:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581117440 00000100:00100000:3.0:1784044529.943950:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784044529.943958:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+22:25090:x1870705581117440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044529.944060:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+22:25090:x1870705581117440:12345-0@lo:502:mount.lustre.0 Request processed in 102us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044529.944067:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784044529.944468:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044529.944520:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1784044529.944528:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1784044529.946237:0:25094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784044529.946250:0:25094:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1784044529.946257:0:25094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044529.946259:0:25094:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1784044529.946268:0:25094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784044529.946283:0:25094:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b38424acd40) 00000020:00000080:2.0:1784044529.946322:0:25094:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784044529.946329:0:25094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784044529.946412:0:25094:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3952664800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1784044529.946430:0:25094:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784044529.946438:0:25094:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x89871fc3aba19d14 00010000:00010000:3.0:1784044529.954404:0:25094:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1784044529.957470:0:25094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1784044529.962790:0:25094:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1784044529.966731:0:25094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1784044529.966753:0:25094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044529.966761:0:25094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044529.966763:0:25094:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1784044529.966767:0:25094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044529.966773:0:25094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044529.966774:0:25094:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784044529.966779:0:25094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784044529.966781:0:25094:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784044529.966783:0:25094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044529.966786:0:25094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044529.966787:0:25094:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784044529.966789:0:25094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044529.966864:0:25094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044529.966866:0:25094:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784044529.966873:0:25094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784044529.966906:0:25094:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044529.966910:0:25094:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044529.966912:0:25094:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784044529.966916:0:25094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1784044529.968222:0:25090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1784044529.968261:0:25090:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784044529.968292:0:25090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba19cff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d06 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044529.968307:0:25090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba19cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d06 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044529.968316:0:25090:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b3952664800 from 1 10000000:01000000:1.0:1784044529.968318:0:25090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044529.968358:0:25090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044529.968367:0:25090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044529.968378:0:25090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044529.968405:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044529.968489:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044529.968533:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a34ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044529.969918:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581117568 00000100:00100000:3.0:1784044529.969932:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581117568 00000100:00100000:3.0:1784044529.970008:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784044529.970020:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+22:25090:x1870705581117568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044529.970037:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044529.970053:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19d22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19d1b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044529.970081:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19d1b expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044529.970092:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19d1b expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044529.970120:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7600, rc 0) 00000100:00100000:3.0:1784044529.970211:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+23:25090:x1870705581117568:12345-0@lo:101:mount.lustre.0 Request processed in 194us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044529.970218:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784044529.970271:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044529.970292:0:25090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044529.970303:0:25090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044529.982728:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1784044529.983062:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784044529.985713:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1784044529.985764:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1784044529.985784:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1784044529.987367:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1784044529.987406:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1784044529.987440:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1784044529.987461:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1784044529.987476:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1784044529.987491:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1784044529.987508:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1784044529.987525:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1784044529.987583:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1784044529.987591:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1784044529.987705:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044529.987774:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044529.987821:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950240180 going to sleep for 11 seconds 00000100:00100000:1.0:1784044529.989465:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581117696 00000100:00100000:1.0:1784044529.989479:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581117696 00000100:00100000:1.0:1784044529.989541:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784044529.989552:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+23:25090:x1870705581117696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044529.989712:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+23:25090:x1870705581117696:12345-0@lo:501:mount.lustre.0 Request processed in 161us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044529.989720:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784044529.989807:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044529.989864:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044529.989920:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044529.989958:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044529.990009:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581117824 00000100:00100000:3.0:1784044529.990014:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581117824 00000100:00100000:3.0:1784044529.990047:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784044529.990054:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+23:25090:x1870705581117824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044529.990150:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+23:25090:x1870705581117824:12345-0@lo:503:mount.lustre.0 Request processed in 96us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044529.990156:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784044529.990738:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117824:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784044529.991151:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784044529.991254:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044529.991298:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044529.991327:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044529.991435:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581117952 00000100:00100000:0.0:1784044529.991441:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581117952 00000100:00100000:0.0:1784044529.991470:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784044529.991477:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+23:25090:x1870705581117952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044529.991590:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+23:25090:x1870705581117952:12345-0@lo:502:mount.lustre.0 Request processed in 95us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044529.991598:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784044529.991639:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581117952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784044529.991828:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1784044529.991853:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1784044529.991869:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1784044529.991883:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1784044529.991897:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1784044529.991911:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1784044529.991924:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1784044529.991938:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1784044529.991951:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1784044529.991964:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1784044529.991977:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1784044529.991999:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044529.992034:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044529.992055:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581118080 00000100:00100000:0.0:1784044529.992059:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581118080 00000100:00100000:0.0:1784044529.992084:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784044529.992089:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+23:25090:x1870705581118080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044529.992157:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+23:25090:x1870705581118080:12345-0@lo:502:mount.lustre.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044529.992163:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784044529.992216:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950240000 going to sleep for 11 seconds 00000100:00100000:0.0:1784044529.992228:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784044529.992258:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1784044529.992265:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1784044529.995315:0:25098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044529.995327:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044529.995329:0:25098:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784044529.995338:0:25098:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3952664800 00000020:00000080:0.0:1784044529.995340:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784044529.995348:0:25098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044529.995351:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044529.995352:0:25098:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784044529.995354:0:25098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044529.995356:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044529.995358:0:25098:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784044529.995361:0:25098:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3952664800 00000020:00000080:0.0:1784044529.995364:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784044529.995446:0:25098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044529.995451:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044529.995453:0:25098:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784044529.995455:0:25098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044529.995458:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044529.995460:0:25098:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784044529.995463:0:25098:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3952664800 00000020:00000080:0.0:1784044529.995465:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784044529.995483:0:25098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044529.995492:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044529.995493:0:25098:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784044529.995496:0:25098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044529.995499:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044529.995500:0:25098:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784044529.995504:0:25098:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3952664800 00000020:00000080:0.0:1784044529.995506:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784044529.995530:0:25098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044529.995533:0:25098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044529.995535:0:25098:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784044529.995538:0:25098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1784044529.997778:0:25090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1784044529.997836:0:25090:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044529.997867:0:25090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044529.997880:0:25090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044529.997955:0:25090:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784044529.997959:0:25090:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b3952664800 10000000:01000000:3.0:1784044529.997962:0:25090:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b3952664800 10000000:01000000:3.0:1784044529.997967:0:25090:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044529.997973:0:25090:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b3952664800 from 1 10000000:01000000:3.0:1784044529.997976:0:25090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784044529.998016:0:25090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6200/0x89871fc3aba19d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044529.998036:0:25090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b6200/0x89871fc3aba19d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044529.998046:0:25090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b6200/0x89871fc3aba19d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044529.998073:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044529.998146:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044529.998349:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3945594d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044529.998718:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581118208 00000100:00100000:0.0:1784044529.998728:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581118208 00000100:00100000:0.0:1784044529.998791:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784044529.998811:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+23:25090:x1870705581118208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044529.998833:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044529.998852:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fc400/0x89871fc3aba19d30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19d29 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044529.998887:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fc400/0x89871fc3aba19d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19d29 expref: 24 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044529.998905:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fc400/0x89871fc3aba19d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19d29 expref: 24 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044529.998918:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc400, rc 0) 00000100:00100000:0.0:1784044529.998969:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581118208:12345-0@lo:101:mount.lustre.0 Request processed in 163us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044529.998976:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784044530.001653:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044530.001682:0:25090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b6200/0x89871fc3aba19d29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d30 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.001696:0:25090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b6200/0x89871fc3aba19d29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19d30 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044530.006762:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1784044530.007092:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044530.009035:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1784044530.009086:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1784044530.009108:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1784044530.009126:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1784044530.009144:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1784044530.009189:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1784044530.009212:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1784044530.009226:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1784044530.013849:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1784044530.013914:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1784044530.013941:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1784044530.013958:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1784044530.013972:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1784044530.013985:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1784044530.013998:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1784044530.014012:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1784044530.014026:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1784044530.014038:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1784044530.014051:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1784044530.014064:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1784044530.014077:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1784044530.014091:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1784044530.014104:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1784044530.014118:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1784044530.014133:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1784044530.014149:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1784044530.014162:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1784044530.014193:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1784044530.014209:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1784044530.014240:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1784044530.014255:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1784044530.014266:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1784044530.014277:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1784044530.014289:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1784044530.014302:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1784044530.014318:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1784044530.014331:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1784044530.014346:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1784044530.014360:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1784044530.014373:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1784044530.014385:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1784044530.014398:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1784044530.014411:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1784044530.014448:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1784044530.014463:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1784044530.014491:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1784044530.014508:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1784044530.014522:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1784044530.014679:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1784044530.014699:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1784044530.014715:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1784044530.014722:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1784044530.014833:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044530.014903:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.014963:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581118336 00000100:00100000:3.0:1784044530.014971:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581118336 00000100:00100000:3.0:1784044530.015025:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784044530.015035:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581118336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044530.015156:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581118336:12345-0@lo:501:mount.lustre.0 Request processed in 123us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.015164:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784044530.015231:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044530.015252:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044530.015289:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044530.015328:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.015369:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3952770a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044530.017794:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581118464 00000100:00100000:2.0:1784044530.017810:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581118464 00000100:00100000:2.0:1784044530.017867:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784044530.017878:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581118464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044530.018045:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581118464:12345-0@lo:503:mount.lustre.0 Request processed in 169us (2715us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044530.018054:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784044530.020564:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784044530.021003:0:25090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044530.021089:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044530.021164:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.022494:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581118592 00000100:00100000:3.0:1784044530.022503:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581118592 00000100:00100000:3.0:1784044530.022553:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784044530.022563:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581118592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044530.022712:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581118592:12345-0@lo:502:mount.lustre.0 Request processed in 149us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.022721:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784044530.022782:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3952770a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044530.022803:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044530.023036:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1784044530.023070:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1784044530.023088:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1784044530.023104:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1784044530.023119:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1784044530.023134:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1784044530.023201:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1784044530.023223:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1784044530.023236:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1784044530.026433:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1784044530.026453:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1784044530.026466:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1784044530.026477:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1784044530.026489:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1784044530.026506:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1784044530.026517:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1784044530.026528:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1784044530.026540:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1784044530.026550:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1784044530.026561:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1784044530.026572:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1784044530.026594:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1784044530.026617:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1784044530.026631:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1784044530.026642:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1784044530.026653:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1784044530.026663:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1784044530.026674:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1784044530.026684:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1784044530.026694:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1784044530.026705:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1784044530.026715:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1784044530.026726:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1784044530.026736:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1784044530.026746:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1784044530.026757:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1784044530.026767:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1784044530.026778:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1784044530.026799:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1784044530.026811:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1784044530.026822:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1784044530.026833:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1784044530.026843:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1784044530.026854:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1784044530.026864:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1784044530.026875:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1784044530.026885:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1784044530.026898:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1784044530.026953:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044530.027021:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.027060:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581118720 00000100:00100000:3.0:1784044530.027066:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581118720 00000100:00100000:3.0:1784044530.027103:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784044530.027114:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581118720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044530.029670:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581118720:12345-0@lo:502:mount.lustre.0 Request processed in 2547us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.029683:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784044530.029771:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3952770a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044530.029796:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044530.030001:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1784044530.030030:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1784044530.030064:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044530.030106:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.030136:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581118848 00000100:00100000:3.0:1784044530.030141:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581118848 00000100:00100000:3.0:1784044530.032412:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784044530.032438:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581118848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044530.032581:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581118848:12345-0@lo:502:mount.lustre.0 Request processed in 158us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.032589:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784044530.032644:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3952770a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044530.032669:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581118848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044530.032734:0:25090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1784044530.032747:0:25090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1784044530.039350:0:25103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784044530.039379:0:25103:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b3844588000) 00000020:00000080:2.0:1784044530.039405:0:25103:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1784044530.039589:0:25103:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3952664800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784044530.039594:0:25103:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3952664800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784044530.039597:0:25103:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3952664800 3 00010000:00080000:2.0:1784044530.039634:0:25103:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3843518800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1784044530.042531:0:25103:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1784044530.042647:0:25103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784044530.042694:0:25103:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784044530.042723:0:25103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x89871fc3aba19d3e 00000100:00080000:2.0:1784044530.042735:0:25103:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784044530.042742:0:25103:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b3843518800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044530.042781:0:25103:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397f9ddf80 x1870705581118976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044530.042810:0:25103:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784044530.042932:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581118976:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784044530.043016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044530.043078:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581118976 00000100:00100000:0.0:1784044530.043085:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581118976 00000100:00100000:0.0:1784044530.043122:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044530.043130:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1870705581118976:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784044530.043152:0:24585:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:0.0:1784044530.043208:0:24585:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x89871fc3aba19d45 00000004:00100000:0.0:1784044530.043224:0:24585:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784044530.043254:0:24585:0:(import.c:65:import_set_state_nolock()) ffff9b3842085800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044530.043304:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870705581118976:12345-0@lo:38:llog_process_th.0 Request processed in 173us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044530.043312:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784044530.043348:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397f9ddf80 x1870705581118976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044530.043358:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784044530.043366:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1784044530.043373:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784044530.043377:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784044530.043380:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3843518800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784044530.043387:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581118976:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1784044530.045344:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044530.045350:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784044530.045354:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044530.045362:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 719 00000100:00080000:3.0:1784044530.045381:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784044530.045387:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3842123800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044530.045409:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397aa57480 x1870705581119360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044530.045473:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044530.045476:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784044530.045479:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044530.045482:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 719 00000100:00080000:3.0:1784044530.045485:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784044530.045489:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b39459d2800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044530.045501:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843cffb80 x1870705581119872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044530.045549:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581119616:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.045629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.045663:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581120256:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.045689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.045713:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784044530.045719:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581119104:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.045742:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.045761:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581119744:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.045786:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.045813:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581119232:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.045835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.045853:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581120000:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.045885:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.045905:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784044530.045910:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581119488:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.045930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.045945:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581120128:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.045964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.045990:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581119616 00000100:00100000:3.0:1784044530.045996:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581119616 00000100:00100000:3.0:1784044530.046060:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581119104 00000100:00100000:3.0:1784044530.046064:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581119104 00000100:00100000:3.0:1784044530.046081:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784044530.046088:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581119616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.046141:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581119616:12345-0@lo:400:kworker.0 Request processed in 52us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.046148:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784044530.046167:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784044530.046194:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581119104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.046224:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581119104:12345-0@lo:400:kworker.0 Request processed in 51us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.046231:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784044530.046251:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581120256 00000100:00100000:3.0:1784044530.046254:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581120256 00000100:00100000:3.0:1784044530.046286:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581120000 00000100:00100000:3.0:1784044530.046289:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581120000 00000100:00100000:3.0:1784044530.046300:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581119488 00000100:00100000:3.0:1784044530.046302:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581119488 00000100:00100000:3.0:1784044530.046312:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581120128 00000100:00100000:3.0:1784044530.046313:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581120128 00000100:00100000:3.0:1784044530.046339:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044530.046345:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581120256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.046378:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581120256:12345-0@lo:400:kworker.0 Request processed in 33us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.046384:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044530.046398:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784044530.046404:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581120000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.046456:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581120000:12345-0@lo:400:kworker.0 Request processed in 52us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.046464:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784044530.046477:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784044530.046484:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581119488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.046512:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581119488:12345-0@lo:400:kworker.0 Request processed in 29us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.046518:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784044530.046530:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784044530.046537:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581120128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.046566:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581120128:12345-0@lo:400:kworker.0 Request processed in 30us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.046573:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784044530.046600:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581119744 00000100:00100000:3.0:1784044530.046604:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581119744 00000100:00100000:3.0:1784044530.046626:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581119232 00000100:00100000:3.0:1784044530.046630:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581119232 00000100:00100000:3.0:1784044530.046650:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784044530.046656:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581119744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.046697:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581119744:12345-0@lo:400:kworker.0 Request processed in 41us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.046705:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784044530.046721:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044530.046728:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581119232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.046755:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581119232:12345-0@lo:400:kworker.0 Request processed in 28us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044530.046762:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1784044530.046792:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044530.046796:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044530.046799:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784044530.046943:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397aa57100 x1870705581119488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044530.046956:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581119488:0@lo:400:kworker.0 00010000:00080000:3.0:1784044530.046969:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843cff100 x1870705581120128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044530.046978:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581120128:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.046988:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581119232:0@lo:400:kworker.0 00010000:00080000:3.0:1784044530.046999:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843cfed80 x1870705581120000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044530.047006:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581120000:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.047049:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581119104:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.047059:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581119744:0@lo:400:kworker.0 00000100:00100000:3.0:1784044530.047078:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581119616:0@lo:400:kworker.0 00010000:00080000:3.0:1784044530.047089:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843cfc380 x1870705581120256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044530.047098:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581120256:0@lo:400:kworker.0 00000100:00100000:0.0:1784044530.048351:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581119360:0@lo:8:kworker.0 00000100:00100000:0.0:1784044530.048407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044530.048451:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581119872:0@lo:8:kworker.0 00000100:00100000:0.0:1784044530.048474:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044530.049225:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581119360 00000100:00100000:2.0:1784044530.049233:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581119360 00000100:00100000:2.0:1784044530.049263:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581119872 00000100:00100000:2.0:1784044530.049266:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581119872 00000100:00100000:2.0:1784044530.049278:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044530.049284:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581119360:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1784044530.049352:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581119360:12345-0@lo:8:kworker.0 Request processed in 67us (944us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784044530.049359:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044530.049382:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044530.049387:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581119872:12345-0@lo:8:kworker.0 00000020:01000004:3.0:1784044530.051803:0:25103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1784044530.051823:0:25103:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9b3843048000) 00000020:00000080:3.0:1784044530.051850:0:25103:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1784044530.052035:0:25103:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3952664800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784044530.052040:0:25103:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3952664800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784044530.052043:0:25103:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3952664800 3 00010000:00080000:3.0:1784044530.052072:0:25103:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3843519000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.140@tcp at head 00000100:00100000:0.0:1784044530.053090:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784044530.053109:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044530.053116:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784044530.053121:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581119360:0@lo:8:kworker.0 00000100:00100000:0.0:1784044530.053137:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784044530.053141:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044530.053145:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784044530.053148:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581119872:0@lo:8:kworker.0 00000100:00100000:2.0:1784044530.054693:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581119872:12345-0@lo:8:kworker.0 Request processed in 33us (946us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784044530.054710:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1784044530.056616:0:25103:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1784044530.056743:0:25103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1784044530.056792:0:25103:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784044530.056804:0:25103:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x89871fc3aba19d53 00000100:00080000:3.0:1784044530.056814:0:25103:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044530.056819:0:25103:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b3843519000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044530.056854:0:25103:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843cfc380 x1870705581120384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044530.056878:0:25103:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1784044530.057819:0:25103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1784044530.057911:0:25090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784044530.057941:0:25090:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784044530.057962:0:25090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6200/0x89871fc3aba19d29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d30 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.057973:0:25090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b6200/0x89871fc3aba19d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d30 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784044530.058030:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784044530.058032:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784044530.058034:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044530.058035:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044530.058036:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044530.058038:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044530.058039:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784044530.058041:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044530.058042:0:25090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784044530.058046:0:25090:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1784044530.058048:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784044530.058049:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784044530.058050:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044530.058051:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044530.058052:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044530.058053:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044530.058054:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784044530.058055:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044530.058056:0:25090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784044530.058075:0:25090:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784044530.058093:0:25090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581120512:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784044530.058460:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1870705581120384:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784044530.058521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044530.060679:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581120384 00000100:00100000:1.0:1784044530.060693:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581120384 00000100:00100000:1.0:1784044530.060743:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044530.060751:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1870705581120384:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784044530.060781:0:22766:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:1.0:1784044530.060819:0:22766:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x89871fc3aba19d5a 00000004:00100000:1.0:1784044530.060836:0:22766:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784044530.060874:0:22766:0:(import.c:65:import_set_state_nolock()) ffff9b396ed77000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044530.060959:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870705581120384:12345-0@lo:38:llog_process_th.0 Request processed in 207us (2438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044530.060968:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1784044530.061020:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843cfc380 x1870705581120384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044530.061032:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784044530.061048:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1784044530.061056:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784044530.061061:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784044530.061064:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3843519000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784044530.061070:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1870705581120384:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784044530.061651:0:25090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.061678:0:25090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3952770cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044530.062489:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581120512 00000100:00100000:1.0:1784044530.062496:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581120512 00000100:00100000:1.0:1784044530.062542:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784044530.062551:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581120512:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784044530.062580:0:22758:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784044530.062595:0:22758:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784044530.085978:0:22758:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784044530.085999:0:22758:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1784044530.086027:0:22780:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784044530.086034:0:22780:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784044530.086056:0:22780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.086074:0:22780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38410b6000/0x89871fc3aba19bee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19be7 expref: 24 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.086083:0:22780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3940030000/0x89871fc3aba19bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19bf5 expref: 24 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.086108:0:22780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.086158:0:22780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3940030000/0x89871fc3aba19bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19bf5 expref: 24 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.086474:0:22780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3940030000/0x89871fc3aba19bfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19bf5 expref: 24 pid: 22758 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044530.086493:0:22780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581120640:0@lo:104: 00000100:00100000:1.0:1784044530.086557:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:25090:x1870705581120512:12345-0@lo:253:mount.lustre.0 Request processed in 24005us (24905us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044530.086569:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784044530.086600:0:25090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccdc2386-7f06-47a4-81d1-1145948bf326:25090:1870705581120512:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784044530.086617:0:25090:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784044530.086621:0:25090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784044530.086623:0:25090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044530.086624:0:25090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044530.086626:0:25090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044530.086627:0:25090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044530.086628:0:25090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044530.086630:0:25090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044530.086632:0:25090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044530.086633:0:25090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784044530.086650:0:25090:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784044530.087400:0:22780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044530.087462:0:22780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38410b6000/0x89871fc3aba19bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19be7 expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044530.087473:0:22780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38410b6000/0x89871fc3aba19bee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19be7 expref: 23 pid: 22759 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044530.087474:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581120640 00000100:00100000:1.0:1784044530.087483:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581120640 00000100:00100000:0.0:1784044530.087488:0:22780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581120768:0@lo:104: 00000100:00100000:0.0:1784044530.087519:0:22780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044530.087532:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581120768 00000100:00100000:0.0:1784044530.087535:0:22780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455946c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044530.087537:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581120768 00000100:00100000:1.0:1784044530.087558:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044530.087566:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+4:22780:x1870705581120640:12345-0@lo:104: 00010000:00010000:1.0:1784044530.087580:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.089713:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044530.089729:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+4:22780:x1870705581120640:12345-0@lo:104: Request processed in 2158us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044530.089755:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044530.089783:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044530.089793:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:22780:x1870705581120768:12345-0@lo:104: 00010000:00010000:1.0:1784044530.089807:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.089872:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784044530.089878:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:22780:x1870705581120768:12345-0@lo:104: Request processed in 88us (2358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044530.089883:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1784044530.089900:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044530.089906:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.089913:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044530.089914:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586efc00 already unused, calling callback (ffffffffc113cc20) 00010000:00010000:3.0:1784044530.089924:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044530.089924:0:22752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.089948:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc113cc20) 00010000:00010000:1.0:1784044530.089949:0:22752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044530.089953:0:23922:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044530.089963:0:22752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.089968:0:23922:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044530.089971:0:22752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00010000:3.0:1784044530.089981:0:23922:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044530.089987:0:23922:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044530.090012:0:23922:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090012:0:22752:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090032:0:22752:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044530.090033:0:23922:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044530.090067:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090070:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.090079:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38410b6600/0x89871fc3aba19be7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19bee expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090083:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba19bf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19bfc expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044530.090099:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044530.090103:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044530.090105:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044530.090106:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044530.090110:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044530.090114:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044530.090123:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581121024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044530.090129:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccdc2386-7f06-47a4-81d1-1145948bf326:3639:1870705581120896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044530.090203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044530.090258:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044530.090277:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581120896 00000100:00100000:1.0:1784044530.090284:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581120896 00010000:00010000:1.0:1784044530.090308:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3940030000/0x89871fc3aba19bfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19bf5 expref: 24 pid: 22758 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044530.090314:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581121024 00000100:00100000:3.0:1784044530.090321:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581121024 00000100:00100000:1.0:1784044530.090336:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1784044530.090341:0:22749:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38410b6000/0x89871fc3aba19bee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19be7 expref: 25 pid: 22759 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044530.090347:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+25:3639:x1870705581120896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044530.090363:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784044530.090368:0:22749:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1784044530.090369:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3940030000/0x89871fc3aba19bfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19bf5 expref: 25 pid: 22758 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044530.090378:0:22749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1784044530.090385:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3940030000/0x89871fc3aba19bfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19bf5 expref: 25 pid: 22758 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090403:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044530.090442:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+25:3639:x1870705581120896:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044530.090449:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044530.090465:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044530.090479:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:3640:x1870705581121024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044530.090489:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044530.090494:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38410b6000/0x89871fc3aba19bee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19be7 expref: 24 pid: 22759 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090503:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38410b6000/0x89871fc3aba19bee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19be7 expref: 24 pid: 22759 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090516:0:22750:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090524:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784044530.090537:0:22750:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004503970s 00010000:00010000:1.0:1784044530.090542:0:22750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090548:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090555:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090561:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090567:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044530.090570:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090586:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090595:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044530.090604:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044530.090641:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:3640:x1870705581121024:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044530.090646:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044530.090689:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccdc2386-7f06-47a4-81d1-1145948bf326:3639:1870705581120896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044530.091599:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581121024:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1784044530.095513:0:25090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:0.0:1784044530.096773:0:22780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940030000/0x89871fc3aba19bfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19bf5 expref: 23 pid: 22758 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044530.096794:0:22780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581120640:0@lo:104: 00010000:00010000:0.0:1784044530.096809:0:22780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b6000/0x89871fc3aba19bee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19be7 expref: 22 pid: 22759 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044530.096819:0:22780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22780:1870705581120768:0@lo:104: 00010000:00010000:0.0:1784044530.096850:0:22780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044530.096860:0:22780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044530.096865:0:22780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044530.096872:0:22780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7e00/0x89871fc3aba19d61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1784044530.106535:0:25090:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1784044530.106544:0:25090:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1784044530.106580:0:25090:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784044530.106621:0:25090:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784044530.106640:0:25090:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1784044530.106661:0:25090:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1784044530.107521:0:25090:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784044530.107808:0:25090:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784044530.200068:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784044531.185748:0:25157:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784044531.185995:0:25157:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784044531.214358:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044531.288525:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581121152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044531.288597:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044531.288650:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581121152 00000100:00100000:0.0:1784044531.288657:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581121152 00000100:00100000:0.0:1784044531.288702:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044531.288711:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581121152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044531.288740:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784044531.288784:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581121152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044531.288792:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044531.288841:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581121152:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1784044531.341911:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784044531.341920:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f3cb000 from 14 10000000:01000000:1.0:1784044531.341927:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784044531.341977:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba19d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044531.341990:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba19d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044531.342003:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba19d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044531.342030:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581121280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044531.342101:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044531.342152:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044531.343225:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581121280 00000100:00100000:2.0:1784044531.343234:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581121280 00000100:00100000:2.0:1784044531.343302:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784044531.343313:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+22:22761:x1870705581121280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044531.343333:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044531.343348:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843799a00/0x89871fc3aba19d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19d68 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044531.343371:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843799a00/0x89871fc3aba19d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19d68 expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044531.343382:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843799a00/0x89871fc3aba19d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19d68 expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044531.343392:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799a00, rc 0) 00000100:00100000:2.0:1784044531.343470:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+23:22761:x1870705581121280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044531.343477:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784044531.343744:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581121280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044531.343762:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba19d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d6f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044531.343779:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba19d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19d6f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044531.343836:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581121408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784044531.343872:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044531.343905:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044531.343986:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581121408 00000100:00100000:0.0:1784044531.343992:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581121408 00000100:00100000:0.0:1784044531.344021:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784044531.344028:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+23:22761:x1870705581121408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784044531.344043:0:22756:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784044531.344065:0:22756:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784044531.344069:0:22756:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1784044531.344151:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+23:22761:x1870705581121408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044531.344159:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784044531.344248:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581121408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784044531.344320:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784044531.344326:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba19d68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d6f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044531.344334:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba19d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d6f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044531.344342:0:22761:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784044531.344344:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b38431d5800 from 14 10000000:01000000:1.0:1784044531.344347:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784044531.344364:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb19c00/0x89871fc3aba19d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044531.344371:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb19c00/0x89871fc3aba19d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044531.344379:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb19c00/0x89871fc3aba19d76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044531.344392:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581121536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044531.344612:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044531.344644:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044531.344822:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581121536 00000100:00100000:0.0:1784044531.344827:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581121536 00000100:00100000:0.0:1784044531.344861:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784044531.344869:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+23:22761:x1870705581121536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044531.344877:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044531.344888:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fd000/0x89871fc3aba19d7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19d76 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044531.344904:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fd000/0x89871fc3aba19d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19d76 expref: 24 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044531.344912:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fd000/0x89871fc3aba19d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19d76 expref: 24 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044531.344920:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd000, rc 0) 00000100:00100000:0.0:1784044531.344951:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+24:22761:x1870705581121536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044531.344957:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784044531.345035:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581121536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044531.345047:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb19c00/0x89871fc3aba19d76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d7d expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044531.345055:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb19c00/0x89871fc3aba19d76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19d7d expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044531.345097:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581121664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784044531.345127:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044531.345147:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044531.345210:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581121664 00000100:00100000:2.0:1784044531.345215:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581121664 00000100:00100000:2.0:1784044531.345248:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784044531.345256:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:22761:x1870705581121664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784044531.345268:0:22758:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784044531.345280:0:22758:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784044531.345384:0:22758:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1784044531.345549:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:22761:x1870705581121664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 294us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044531.345556:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784044531.345705:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581121664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784044531.345756:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784044531.345763:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb19c00/0x89871fc3aba19d76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d7d expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044531.345771:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb19c00/0x89871fc3aba19d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19d7d expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044532.239340:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044533.269560:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044534.285519:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044534.349459:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581121792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044534.349534:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044534.349729:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581122048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044534.349761:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044534.349804:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581122048 00000100:00100000:3.0:1784044534.349811:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581122048 00000100:00100000:3.0:1784044534.349867:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784044534.349877:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581122048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784044534.349919:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784044534.349963:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581122048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044534.349980:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1784044534.350001:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044534.350038:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581122048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044534.350166:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581121920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044534.350226:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044534.351784:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581121792 00000100:00100000:2.0:1784044534.351796:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581121792 00000100:00100000:2.0:1784044534.351853:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581121920 00000100:00100000:2.0:1784044534.351857:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581121920 00000100:00100000:2.0:1784044534.351878:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784044534.351904:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581121792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044534.351944:0:22770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1784044534.352024:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581121792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044534.352031:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784044534.352047:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784044534.352053:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581121920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784044534.352070:0:22770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784044534.352123:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581121920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044534.352129:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784044534.352193:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581121920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044534.352232:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581121792:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1784044535.184933:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784044535.310803:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044535.374308:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccdc2386-7f06-47a4-81d1-1145948bf326:3641:1870705581122176:0@lo:400:kworker.0 00000100:00100000:0.0:1784044535.374400:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044535.374484:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581122176 00000100:00100000:1.0:1784044535.374491:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581122176 00000100:00100000:1.0:1784044535.374538:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784044535.374547:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:3641:x1870705581122176:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784044535.374686:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044535.374690:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784044535.374693:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044535.374700:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3842123800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044535.374718:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397f9df800 x1870705581122560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784044535.378869:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:3641:x1870705581122176:12345-0@lo:400:kworker.0 Request processed in 4311us (4459us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044535.378884:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784044535.378954:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581122560:0@lo:8:kworker.0 00000100:00100000:1.0:1784044535.379000:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044535.379044:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581122560 00000100:00100000:1.0:1784044535.379051:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581122560 00000100:00100000:1.0:1784044535.379084:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044535.379090:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705581122560:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1784044535.379135:0:24274:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:1.0:1784044535.379167:0:24274:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba19d84 00002000:00100000:1.0:1784044535.379198:0:24274:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b396ed73800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784044535.379203:0:24274:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1784044535.379206:0:24274:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784044535.379382:0:24274:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784044535.379411:0:24274:0:(import.c:65:import_set_state_nolock()) ffff9b396ed71000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044535.379580:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1870705581122560:12345-0@lo:8:kworker.0 Request processed in 487us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044535.379588:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1784044535.379627:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9df800 x1870705581122560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784044535.379641:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1784044535.379648:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784044535.379653:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784044535.379655:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842123800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784044535.379677:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784044535.379694:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581122560:0@lo:8:kworker.0 00000004:00080000:1.0:1784044535.379740:0:22791:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1784044535.379756:0:22791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22791:1870705581122944:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784044535.379782:0:22791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044535.379798:0:22791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394692b840 going to sleep for 11 seconds 00000100:00100000:1.0:1784044535.379810:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581122944 00000100:00100000:1.0:1784044535.379815:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581122944 00000100:00100000:1.0:1784044535.379848:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044535.379855:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22791:x1870705581122944:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1784044535.380468:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1784044535.380596:0:22790:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1784044535.380611:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581122432:0@lo:400:kworker.0 00000100:00100000:1.0:1784044535.380646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1784044535.380668:0:22790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 728551493115ns, next at 0ns, rc = 0 00000100:00100000:1.0:1784044535.380670:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00080000:00080000:3.0:1784044535.380674:0:22790:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1784044535.380676:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581122304:0@lo:400:kworker.0 00000100:00100000:1.0:1784044535.380699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044535.380729:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581122688:0@lo:400:kworker.0 00000100:00100000:1.0:1784044535.380754:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044535.380772:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044535.380778:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581122816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044535.380798:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044535.380821:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581122688 00000100:00100000:1.0:1784044535.380826:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581122688 00000100:00100000:1.0:1784044535.380855:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784044535.380861:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581122688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044535.380899:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581122688:12345-0@lo:400:kworker.0 Request processed in 38us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044535.380917:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784044535.380939:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581122816 00000100:00100000:1.0:1784044535.380942:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581122816 00000100:00100000:1.0:1784044535.380964:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044535.380970:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1870705581122816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044535.381004:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784044535.381038:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1870705581122816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044535.381045:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044535.381066:0:24275:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1784044535.381073:0:24275:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:1.0:1784044535.381102:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b7e300 x1870705581122816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044535.381324:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581122816:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1784044535.381340:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9dfb80 x1870705581122688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044535.381349:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581122688:0@lo:400:kworker.0 00000100:00080000:2.0:1784044535.382245:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00002000:00080000:1.0:1784044535.382441:0:24276:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1784044535.382449:0:24276:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00000100:00080000:2.0:1784044535.382522:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784044535.382526:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044535.382536:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b39459d2800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044535.382565:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843d83800 x1870705581123328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:02000040:1.0:1784044535.382871:0:24276:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000100:00100000:2.0:1784044535.383269:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581122304 00000100:00100000:2.0:1784044535.383276:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581122304 00000100:00100000:2.0:1784044535.383328:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784044535.383337:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581122304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.383423:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581122304:12345-0@lo:400:kworker.0 Request processed in 87us (2722us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044535.383431:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1784044535.384662:0:22744:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1784044535.384702:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581123072:0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.384752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044535.384779:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581123712:0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.384802:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044535.384826:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784044535.384833:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581123200:0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.384853:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044535.384869:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581123840:0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.384890:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044535.384914:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581123072 00000100:00100000:2.0:1784044535.384919:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581123072 00000100:00100000:2.0:1784044535.384952:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784044535.384959:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581123072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.385000:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581123072:12345-0@lo:400:kworker.0 Request processed in 41us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044535.385006:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784044535.385033:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581123712 00000100:00100000:2.0:1784044535.385037:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581123712 00000100:00100000:2.0:1784044535.385066:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581123840 00000100:00100000:2.0:1784044535.385068:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581123840 00000100:00100000:2.0:1784044535.385086:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044535.385091:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581123712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044535.385220:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccdc2386-7f06-47a4-81d1-1145948bf326:3641:1870705581122176:0@lo:400:kworker.0 00000100:00100000:0.0:1784044535.385260:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581123584:0@lo:400:kworker.0 00000100:00100000:0.0:1784044535.385289:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044535.385303:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784044535.385310:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581123456:0@lo:400:kworker.0 00000100:00100000:0.0:1784044535.385330:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044535.385341:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581123968:0@lo:400:kworker.0 00000100:00100000:0.0:1784044535.385359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044535.386207:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581123712:12345-0@lo:400:kworker.0 Request processed in 1113us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044535.386216:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044535.386234:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581123584 00000100:00100000:2.0:1784044535.386239:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581123584 00000100:00100000:2.0:1784044535.386260:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581123456 00000100:00100000:2.0:1784044535.386263:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581123456 00000100:00100000:2.0:1784044535.386272:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581123968 00000100:00100000:2.0:1784044535.386274:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581123968 00000100:00100000:2.0:1784044535.386288:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784044535.386294:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705581123840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.386332:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705581123840:12345-0@lo:400:kworker.0 Request processed in 38us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044535.386338:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784044535.386349:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784044535.386354:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581123584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.386394:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581123584:12345-0@lo:400:kworker.0 Request processed in 40us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044535.386400:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784044535.386411:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784044535.386416:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581123456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.386442:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581123456:12345-0@lo:400:kworker.0 Request processed in 26us (1111us total) trans 0 rc 0/0 00010000:00080000:0.0:1784044535.386573:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d81f80 x1870705581123456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044535.386587:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581123456:0@lo:400:kworker.0 00010000:00080000:0.0:1784044535.386598:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d80000 x1870705581123584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044535.386607:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581123584:0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.386656:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784044535.386670:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784044535.386676:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705581123968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.386751:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705581123968:12345-0@lo:400:kworker.0 Request processed in 75us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044535.386757:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1784044535.386795:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d80e00 x1870705581123840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044535.386805:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581123840:0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.386816:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581123072:0@lo:400:kworker.0 00010000:00080000:2.0:1784044535.386824:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d82680 x1870705581123712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044535.386832:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581123712:0@lo:400:kworker.0 00000100:00080000:2.0:1784044535.386852:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044535.386856:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044535.386872:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581123328:0@lo:8:kworker.0 00000100:00100000:2.0:1784044535.386899:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044535.386925:0:24274:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044535.386932:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581122432 00000100:00100000:2.0:1784044535.386936:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581122432 00000100:00100000:2.0:1784044535.386958:0:24274:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044535.386961:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581123200 00000100:00100000:2.0:1784044535.386964:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581123200 00000100:00100000:2.0:1784044535.386972:0:24274:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044535.386975:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581123328 00000100:00100000:2.0:1784044535.386982:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581123328 00000100:00100000:2.0:1784044535.386991:0:24274:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044535.386997:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784044535.387001:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581122432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.387031:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581122432:12345-0@lo:400:kworker.0 Request processed in 29us (6384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044535.387037:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784044535.387045:0:24274:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044535.387050:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044535.387054:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581123200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044535.387081:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581123200:12345-0@lo:400:kworker.0 Request processed in 26us (2226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044535.387087:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044535.387111:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581123200:0@lo:400:kworker.0 00000100:00080000:2.0:1784044535.387124:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784044535.392581:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d82a00 x1870705581123968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044535.392602:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581123968:0@lo:400:kworker.0 00000100:00100000:0.0:1784044535.392884:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581122304:0@lo:400:kworker.0 00000100:00100000:0.0:1784044535.392897:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581122432:0@lo:400:kworker.0 00002000:00010000:1.0:1784044535.395585:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.395597:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19d8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.395616:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.395626:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.395634:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19d8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.395652:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19d8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.395663:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19d8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.395672:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19d8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.395689:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784044535.396025:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784044535.396035:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1870705581123328:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1784044535.396071:0:25382:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:1.0:1784044535.396102:0:25382:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba19d92 00002000:00100000:1.0:1784044535.396134:0:25382:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9b3942bb8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1784044535.396139:0:25382:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1784044535.396142:0:25382:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784044535.396212:0:25382:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1784044535.396241:0:25382:0:(import.c:65:import_set_state_nolock()) ffff9b397f9b5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044535.396335:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3637:x1870705581123328:12345-0@lo:8:kworker.0 Request processed in 300us (9434us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044535.396343:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1784044535.396415:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1784044535.396422:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784044535.396428:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784044535.396430:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39459d2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784044535.396444:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784044535.396451:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581123328:0@lo:8:kworker.0 00000004:00080000:1.0:1784044535.396479:0:23510:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784044535.396540:0:23510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 728567365001ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784044535.396546:0:23510:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:0.0:1784044535.397031:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044535.397040:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19d8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.397058:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.397063:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19d8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.397072:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19d8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.397095:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19d8b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.397103:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19d8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.397135:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.397137:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.397139:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784044535.397219:0:23511:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1784044535.397244:0:23511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23511:1870705581124224:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1784044535.397286:0:23511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044535.397313:0:23511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f35f840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044535.397326:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044535.397335:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581124096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044535.397360:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044535.397784:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581124096 00000100:00100000:1.0:1784044535.397791:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581124096 00000100:00100000:1.0:1784044535.397835:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044535.397844:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870705581124096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044535.397867:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1784044535.398292:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581124096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044535.398937:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870705581124096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1092us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044535.398947:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:1.0:1784044535.399701:0:23500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1784044535.399842:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.399850:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cdf53ba/0x89871fc3aba19d99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.399867:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.399872:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.399880:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cdf53ba/0x89871fc3aba19d99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.399894:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cdf53ba/0x89871fc3aba19d99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.399911:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cdf53ba/0x89871fc3aba19d99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.399919:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cdf53ba/0x89871fc3aba19d99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.399942:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044535.400386:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.400394:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000842c2105/0x89871fc3aba19da0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.400403:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.400407:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.400411:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000842c2105/0x89871fc3aba19da0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.400418:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044535.400421:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000842c2105/0x89871fc3aba19da0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.400425:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cdf53ba/0x89871fc3aba19d99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.400429:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000842c2105/0x89871fc3aba19da0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.400433:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044535.400436:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000842c2105/0x89871fc3aba19da0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.400438:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cdf53ba/0x89871fc3aba19d99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.400447:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cdf53ba/0x89871fc3aba19d99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.400469:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cdf53ba/0x89871fc3aba19d99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.400476:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cdf53ba/0x89871fc3aba19d99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.400493:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.400495:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.400496:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.400571:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044535.400880:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.400886:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba19da7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.400894:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.400896:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.400900:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba19da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.400908:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba19da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.400915:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba19da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.400921:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba19da7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.400953:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044535.400963:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000842c2105/0x89871fc3aba19da0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.400970:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.400973:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000842c2105/0x89871fc3aba19da0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.400980:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000842c2105/0x89871fc3aba19da0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044535.400990:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581124224 00010000:00010000:0.0:1784044535.400990:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000842c2105/0x89871fc3aba19da0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.400997:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000842c2105/0x89871fc3aba19da0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044535.400999:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581124224 00010000:00010000:0.0:1784044535.401010:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044535.401013:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba19da7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.401018:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.401021:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba19da7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.401029:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba19da7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.401048:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba19da7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.401056:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.401057:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.401059:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044535.401061:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784044535.401071:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23511:x1870705581124224:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1784044535.401681:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784044535.401781:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784044535.401787:0:24276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba19da7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044535.401969:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044535.402497:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.402505:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba19dae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.402775:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.402790:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.402797:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba19dae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.402811:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba19dae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.402820:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba19dae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.402828:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba19dae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.402847:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044535.403281:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044535.403290:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba19dae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.403299:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044535.403304:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba19dae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.403313:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba19dae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784044535.403492:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.403499:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19db5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.403508:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.403511:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.403681:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba19dae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.403689:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba19dae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.403703:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.403705:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.403707:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.403931:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19db5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.403944:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19db5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.403963:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19db5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.403970:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19db5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.403993:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044535.404134:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044535.404140:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19db5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.404147:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044535.404150:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19db5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.404170:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19db5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.404439:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19db5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.404446:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19db5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.404460:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.404462:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.404463:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044535.404762:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.404768:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19dbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.404779:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.404782:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.404788:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19dbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.404797:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19dbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.404805:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19dbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.404812:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19dbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.404839:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044535.405086:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044535.405092:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19dbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.405099:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.405103:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19dbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784044535.405224:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.405230:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004127d14f/0x89871fc3aba19dc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.405239:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.405242:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.405246:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004127d14f/0x89871fc3aba19dc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.405256:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004127d14f/0x89871fc3aba19dc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.405264:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004127d14f/0x89871fc3aba19dc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.405271:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004127d14f/0x89871fc3aba19dc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.405283:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044535.405552:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19dbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.405569:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19dbc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.405576:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b83239d4/0x89871fc3aba19dbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.405592:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044535.405595:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004127d14f/0x89871fc3aba19dc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.405611:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.405615:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004127d14f/0x89871fc3aba19dc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.405622:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004127d14f/0x89871fc3aba19dc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.405632:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004127d14f/0x89871fc3aba19dc3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.405640:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004127d14f/0x89871fc3aba19dc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.405651:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.405653:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.405654:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.405741:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044535.406124:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.406131:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa6f53b/0x89871fc3aba19dca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.406141:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.406148:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.406153:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efa6f53b/0x89871fc3aba19dca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.406162:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efa6f53b/0x89871fc3aba19dca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.406170:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa6f53b/0x89871fc3aba19dca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.406198:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efa6f53b/0x89871fc3aba19dca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.406437:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044535.406791:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.406798:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd9408a3/0x89871fc3aba19dd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.406807:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.406811:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.406815:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd9408a3/0x89871fc3aba19dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.406825:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd9408a3/0x89871fc3aba19dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.406833:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd9408a3/0x89871fc3aba19dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.406845:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd9408a3/0x89871fc3aba19dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.406866:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784044535.407066:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044535.407072:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efa6f53b/0x89871fc3aba19dca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.407081:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a2200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.407085:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa6f53b/0x89871fc3aba19dca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.407093:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa6f53b/0x89871fc3aba19dca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.407123:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efa6f53b/0x89871fc3aba19dca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.407130:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efa6f53b/0x89871fc3aba19dca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.407147:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044535.407150:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd9408a3/0x89871fc3aba19dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.407157:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.407161:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd9408a3/0x89871fc3aba19dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.407168:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd9408a3/0x89871fc3aba19dd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.407198:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd9408a3/0x89871fc3aba19dd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.407205:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd9408a3/0x89871fc3aba19dd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.407217:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.407218:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.407225:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044535.407310:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.407316:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000719182f2/0x89871fc3aba19dd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.407325:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.407328:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.407332:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000719182f2/0x89871fc3aba19dd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.407341:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000719182f2/0x89871fc3aba19dd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.407348:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000719182f2/0x89871fc3aba19dd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.407354:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000719182f2/0x89871fc3aba19dd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.407370:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044535.407389:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044535.407393:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000719182f2/0x89871fc3aba19dd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.407407:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a2400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044535.407410:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000719182f2/0x89871fc3aba19dd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.407417:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000719182f2/0x89871fc3aba19dd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.407427:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000719182f2/0x89871fc3aba19dd8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.407434:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000719182f2/0x89871fc3aba19dd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.407447:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.407448:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.407450:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.408122:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044535.408863:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.408872:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b5a749d/0x89871fc3aba19ddf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.408885:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.408889:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.408895:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b5a749d/0x89871fc3aba19ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.408906:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b5a749d/0x89871fc3aba19ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.408921:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b5a749d/0x89871fc3aba19ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.408929:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b5a749d/0x89871fc3aba19ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.408944:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044535.409108:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044535.409120:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b5a749d/0x89871fc3aba19ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.409129:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.409133:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b5a749d/0x89871fc3aba19ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.409141:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b5a749d/0x89871fc3aba19ddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.409156:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b5a749d/0x89871fc3aba19ddf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.409164:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b5a749d/0x89871fc3aba19ddf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.409196:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.409198:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.409200:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784044535.411081:0:24274:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1784044535.411089:0:24274:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1784044535.411581:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23511:x1870705581124224:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10507us (14289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044535.411592:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00002000:00010000:1.0:1784044535.411680:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.411688:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce30bc1/0x89871fc3aba19de6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.411704:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.411709:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.411716:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cce30bc1/0x89871fc3aba19de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.411729:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cce30bc1/0x89871fc3aba19de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.411739:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce30bc1/0x89871fc3aba19de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.411753:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cce30bc1/0x89871fc3aba19de6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.411768:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044535.411779:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044535.411784:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cce30bc1/0x89871fc3aba19de6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.411792:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a2a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044535.411796:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce30bc1/0x89871fc3aba19de6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.411804:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce30bc1/0x89871fc3aba19de6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.411819:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cce30bc1/0x89871fc3aba19de6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.411826:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cce30bc1/0x89871fc3aba19de6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.411840:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.411842:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.411843:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044535.412320:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.412334:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbfd1348/0x89871fc3aba19ded lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.412343:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.412346:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.412351:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfd1348/0x89871fc3aba19ded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.412360:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbfd1348/0x89871fc3aba19ded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.412368:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbfd1348/0x89871fc3aba19ded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.412387:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfd1348/0x89871fc3aba19ded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.412402:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044535.412731:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.412737:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a49705b/0x89871fc3aba19df4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.412745:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.412748:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.412752:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a49705b/0x89871fc3aba19df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.412761:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a49705b/0x89871fc3aba19df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.412774:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a49705b/0x89871fc3aba19df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.412781:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a49705b/0x89871fc3aba19df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.412796:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784044535.413044:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.413049:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba19dfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413057:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.413060:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.413065:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba19dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413074:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba19dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413083:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba19dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413090:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba19dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413166:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784044535.413196:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784044535.413201:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbfd1348/0x89871fc3aba19ded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413208:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044535.413212:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbfd1348/0x89871fc3aba19ded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413220:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbfd1348/0x89871fc3aba19ded lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413235:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbfd1348/0x89871fc3aba19ded lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413243:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbfd1348/0x89871fc3aba19ded lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413259:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044535.413262:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a49705b/0x89871fc3aba19df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413268:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a2600 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044535.413272:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a49705b/0x89871fc3aba19df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413290:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a49705b/0x89871fc3aba19df4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413300:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a49705b/0x89871fc3aba19df4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413307:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a49705b/0x89871fc3aba19df4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413320:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044535.413323:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba19dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413329:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a2c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044535.413333:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba19dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413339:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba19dfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413348:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba19dfb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413354:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba19dfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413387:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.413389:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.413391:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044535.413824:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.413830:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc694399/0x89871fc3aba19e02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413838:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.413842:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.413847:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc694399/0x89871fc3aba19e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413856:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc694399/0x89871fc3aba19e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413863:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc694399/0x89871fc3aba19e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413870:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc694399/0x89871fc3aba19e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413883:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044535.413889:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044535.413893:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc694399/0x89871fc3aba19e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413909:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044535.413913:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc694399/0x89871fc3aba19e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413921:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc694399/0x89871fc3aba19e02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413932:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc694399/0x89871fc3aba19e02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413938:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc694399/0x89871fc3aba19e02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.413951:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.413952:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.413954:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044535.414246:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.414251:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.414260:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.414263:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.414267:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.414276:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.414290:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.414297:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.414309:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044535.414317:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044535.414320:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.414326:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044535.414330:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.414337:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.414348:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.414355:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.414367:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.414385:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.414387:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044535.414770:0:23511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23511:1870705581124224:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1784044535.414788:0:23511:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1784044535.414835:0:23511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23511:1870705581124352:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1784044535.414899:0:23511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044535.414927:0:23511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969d80 going to sleep for 11 seconds 00010000:00010000:3.0:1784044535.414942:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044535.415032:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581124352 00000100:00100000:1.0:1784044535.415039:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581124352 00000100:00100000:1.0:1784044535.415081:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784044535.415090:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23511:x1870705581124352:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1784044535.415127:0:25382:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1784044535.415167:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23511:x1870705581124352:12345-0@lo:5:osp-pre-1-1.0 Request processed in 77us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044535.415206:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044535.415344:0:23511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23511:1870705581124352:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1784044535.415353:0:23511:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1784044535.415392:0:23511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23511:1870705581124480:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1784044535.415416:0:23511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044535.415446:0:23511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969d80 going to sleep for 11 seconds 00002000:00010000:3.0:1784044535.415515:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.415521:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19e10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.415533:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.415536:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.415542:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.415552:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.415561:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.415569:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.415584:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044535.415592:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044535.415597:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.415605:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044535.415608:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.415627:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19e10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.415640:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19e10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.415647:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19e10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.415661:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.415663:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.415665:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044535.416056:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.416063:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416072:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.416075:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.416079:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416088:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416096:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416109:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416133:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044535.416141:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044535.416146:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416153:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044535.416156:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416162:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416198:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416205:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416218:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.416220:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.416221:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044535.416570:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.416583:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416591:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.416597:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.416601:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416610:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416618:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416623:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416636:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044535.416644:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044535.416648:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416655:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044535.416657:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416664:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416682:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416688:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416700:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.416701:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.416703:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044535.416942:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.416948:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416957:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.416960:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.416963:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416971:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416979:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.416986:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.417009:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044535.417017:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044535.417021:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.417028:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044535.417031:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.417039:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.417049:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.417057:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.417069:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.417071:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.417073:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044535.417210:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581124480 00000100:00100000:1.0:1784044535.417217:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581124480 00000100:00100000:1.0:1784044535.417260:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784044535.417268:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23511:x1870705581124480:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1784044535.417302:0:24274:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:3.0:1784044535.417819:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.417826:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e170421d/0x89871fc3aba19e2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.417837:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.417846:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.417852:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e170421d/0x89871fc3aba19e2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.417863:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e170421d/0x89871fc3aba19e2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.417872:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e170421d/0x89871fc3aba19e2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.417879:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e170421d/0x89871fc3aba19e2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.417898:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044535.418122:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044535.418128:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e170421d/0x89871fc3aba19e2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.418137:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044535.418141:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e170421d/0x89871fc3aba19e2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.418149:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e170421d/0x89871fc3aba19e2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.418162:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e170421d/0x89871fc3aba19e2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.418199:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e170421d/0x89871fc3aba19e2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.418215:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.418217:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044535.418219:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044535.418961:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.418968:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.418979:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.418983:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.418989:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.419000:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.419009:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.419021:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.419035:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044535.419045:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044535.419050:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.419058:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044535.419061:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.419070:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.419081:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.419088:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.419103:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.419105:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.419106:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.419442:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044535.420922:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.420940:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.420956:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.420961:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.420970:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.420983:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.420993:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.421001:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.421020:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044535.421029:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044535.421034:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.421042:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044535.421046:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.421055:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.421077:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.421085:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.421100:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.421102:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.421104:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044535.426385:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044535.426401:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.426419:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=728s v=(0 0) 00010000:00010000:1.0:1784044535.426424:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044535.426430:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.426445:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.426515:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.426524:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044535.426580:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784044535.429054:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.429066:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.429083:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.429088:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.429095:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.429109:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.429125:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.429134:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.429694:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044535.429704:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.429714:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.429719:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.429734:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.429751:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.429759:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c1e7aec/0x89871fc3aba19e41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.429778:0:22752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044535.429782:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.429789:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.429792:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.429799:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.429808:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e48 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.429816:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.429817:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.429823:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044535.430212:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784044535.430218:0:24276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19e48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.430683:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044535.430798:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.430805:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.430818:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.430821:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.430827:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.430839:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.430848:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.430856:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.430878:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044535.431097:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044535.431102:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.431119:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.431123:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.431131:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.431143:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.431149:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19e4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.431165:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.431167:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.431169:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784044535.431341:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.431348:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.431362:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.431365:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.431370:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.431391:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.431398:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.431406:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.431424:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784044535.431737:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.431744:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.431753:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.431756:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.431760:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.431769:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.431788:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.431795:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.431806:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784044535.432045:0:24276:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044535.432050:0:24276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.432058:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=728s v=(0 0) 00010000:00010000:3.0:1784044535.432061:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044535.432065:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.432074:0:24276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.432082:0:24276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.432089:0:24276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044535.432195:0:24276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1784044535.432225:0:24276:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1784044535.432318:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22791:x1870705581122944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 52460us (52531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044535.432328:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784044535.432393:0:22791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22791:1870705581122944:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784044535.432407:0:22791:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1784044535.432519:0:22791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22791:1870705581124608:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784044535.432555:0:22791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044535.432579:0:22791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39482cc240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044535.432599:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581124608 00000100:00100000:3.0:1784044535.432604:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581124608 00000100:00100000:3.0:1784044535.432641:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044535.432650:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22791:x1870705581124608:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1784044535.432686:0:24275:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:0.0:1784044535.432925:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784044535.432933:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.432942:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.432946:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.432960:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.432977:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.432985:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba19e56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.433003:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044535.433007:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.433013:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.433016:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.433024:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.433034:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.433040:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19e5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.433064:0:22753:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044535.433067:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.433074:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044535.433077:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.433084:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.433094:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.433102:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f2304e4/0x89871fc3aba19e64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044535.433125:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.433127:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.433129:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.433136:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044535.433141:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784044535.452460:0:25091:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1784044535.452512:0:25091:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1784044535.452523:0:25091:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784044535.452686:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22791:x1870705581124608:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20032us (20125us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1784044535.452697:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044535.452754:0:22791:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1784044535.452761:0:22791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22791:1870705581124608:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784044535.452788:0:22791:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:0.0:1784044535.470872:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23511:x1870705581124480:12345-0@lo:5:osp-pre-1-1.0 Request processed in 53598us (55449us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1784044535.470886:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784044535.471014:0:23511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23511:1870705581124480:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1784044535.471031:0:23511:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1784044535.471074:0:23511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23511:1870705581124736:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1784044535.471121:0:23511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044535.471156:0:23511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39482cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044535.471403:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581124736 00000100:00100000:0.0:1784044535.471414:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581124736 00000100:00100000:0.0:1784044535.471524:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044535.471533:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23511:x1870705581124736:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1784044535.471587:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23511:x1870705581124736:12345-0@lo:900:osp-pre-1-1.0 Request processed in 55us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044535.471595:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784044535.471658:0:23511:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cff800 x1870705581124736/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784044551 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044535.471670:0:23511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23511:1870705581124736:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1784044536.339572:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044536.401780:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044536.401804:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581124864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044536.401875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044536.401927:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581124864 00000100:00100000:2.0:1784044536.401950:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581124864 00000100:00100000:2.0:1784044536.401999:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784044536.402008:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581124864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044536.402050:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044536.402092:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581124864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044536.402100:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784044536.402143:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581124864:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1784044536.828835:0:25448:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784044537.358755:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784044537.870597:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1784044538.055920:0:25500:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784044538.056137:0:25500:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784044538.381831:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784044538.942832:0:25550:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784044538.943069:0:25550:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784044539.234730:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044539.234811:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565259008 00000100:00100000:0.0:1784044539.234822:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565259008 00000100:00100000:0.0:1784044539.234867:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:0.0:1784044539.234875:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2406:x1870705565259008:12345-192.168.202.40@tcp:250:mount.lustre.0 00010000:00080000:0.0:1784044539.234945:0:22759:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 740c6da5-f7fc-45c9-b5c9-a88235e5f76d@192.168.202.40@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:0.0:1784044539.234975:0:22759:0:(genops.c:1406:class_connect()) connect: client 740c6da5-f7fc-45c9-b5c9-a88235e5f76d, cookie 0x89871fc3aba19e6b 00000100:00080000:0.0:1784044539.235118:0:22759:0:(import.c:65:import_set_state_nolock()) ffff9b3976b41000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044539.235218:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+5:2406:x1870705565259008:12345-192.168.202.40@tcp:250:mount.lustre.0 Request processed in 342us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044539.235227:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:1.0:1784044539.254079:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044539.254370:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565259136 00000100:00100000:0.0:1784044539.254380:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565259136 00000100:00100000:2.0:1784044539.254548:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:2.0:1784044539.254560:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+5:18093:x1870705565259136:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784044539.254578:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044539.254597:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798e00/0x89871fc3aba19e72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6be8 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044539.254626:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798e00/0x89871fc3aba19e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6be8 expref: 6 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044539.254640:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798e00/0x89871fc3aba19e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6be8 expref: 6 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044539.254651:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798e00, rc 0) 00000100:00100000:2.0:1784044539.254710:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+6:18093:x1870705565259136:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 152us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044539.254718:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:3.0:1784044539.267545:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044539.267697:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565259264 00000100:00100000:1.0:1784044539.267711:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565259264 00000100:00100000:1.0:1784044539.267790:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:1.0:1784044539.267816:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+6:18093:x1870705565259264:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784044539.268004:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+6:18093:x1870705565259264:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 194us (476us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784044539.268014:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:1.0:1784044539.276869:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044539.277119:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565259392 00000100:00100000:2.0:1784044539.277134:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565259392 00000100:00100000:2.0:1784044539.277292:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:2.0:1784044539.277305:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+6:18093:x1870705565259392:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784044539.277328:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044539.277368:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843799800/0x89871fc3aba19e79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6bef expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044539.277407:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843799800/0x89871fc3aba19e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bef expref: 7 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044539.277421:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843799800/0x89871fc3aba19e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bef expref: 7 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044539.277431:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799800, rc 0) 00000100:00100000:2.0:1784044539.277520:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+7:18093:x1870705565259392:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 217us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044539.277529:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:2.0:1784044539.280314:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044539.280394:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565259520 00000100:00100000:0.0:1784044539.280408:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565259520 00000100:00100000:0.0:1784044539.280489:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:0.0:1784044539.280501:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+7:18093:x1870705565259520:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784044539.280729:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+8:18093:x1870705565259520:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 229us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044539.280738:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:3.0:1784044539.282658:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044539.282733:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565259648 00000100:00100000:1.0:1784044539.282745:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565259648 00000100:00100000:1.0:1784044539.282813:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:1.0:1784044539.282825:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+8:18093:x1870705565259648:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784044539.283015:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+8:18093:x1870705565259648:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 191us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044539.283024:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:1.0:1784044539.292921:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044539.293289:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565259776 00000100:00100000:2.0:1784044539.293304:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565259776 00000100:00100000:2.0:1784044539.293398:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:2.0:1784044539.293411:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+8:18112:x1870705565259776:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044539.293708:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+8:18112:x1870705565259776:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 298us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044539.293717:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:2.0:1784044539.324730:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044539.324885:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565259904 00000100:00100000:0.0:1784044539.324923:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565259904 00000100:00100000:2.0:1784044539.325039:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:2.0:1784044539.325057:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+8:18112:x1870705565259904:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044539.325271:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+8:18112:x1870705565259904:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 220us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044539.325280:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:2.0:1784044539.334985:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044539.336357:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565260032 00000100:00100000:1.0:1784044539.336373:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565260032 00000100:00100000:1.0:1784044539.336453:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:1.0:1784044539.336464:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+8:18112:x1870705565260032:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044539.336632:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+8:18112:x1870705565260032:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 170us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044539.336647:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:1.0:1784044539.338968:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044539.339046:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565260160 00000100:00100000:2.0:1784044539.339053:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565260160 00000100:00100000:2.0:1784044539.339220:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:2.0:1784044539.339231:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+8:18093:x1870705565260160:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784044539.339303:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044539.339334:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798000/0x89871fc3aba19e80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6c20 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044539.339377:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798000/0x89871fc3aba19e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c20 expref: 9 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044539.339388:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798000/0x89871fc3aba19e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c20 expref: 9 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044539.339397:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798000, rc 0) 00000100:00100000:2.0:1784044539.339441:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+9:18093:x1870705565260160:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 213us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044539.339447:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:2.0:1784044539.344249:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044539.344344:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565260288 00000100:00100000:0.0:1784044539.344355:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565260288 00000100:00100000:0.0:1784044539.344407:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:0.0:1784044539.344418:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+9:18093:x1870705565260288:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784044539.344441:0:22759:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784044539.344465:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784044539.344469:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784044539.344472:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784044539.344475:0:22759:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1784044539.344478:0:22759:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1784044539.347355:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+9:18093:x1870705565260288:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 2915us (3096us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044539.347370:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:2.0:1784044539.350235:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044539.350466:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565260416 00000100:00100000:1.0:1784044539.350481:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565260416 00000100:00100000:1.0:1784044539.350559:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:1.0:1784044539.350570:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39749fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+9:18093:x1870705565260416:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784044539.350592:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044539.350617:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38423a3200/0x89871fc3aba19e87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6c27 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044539.350663:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38423a3200/0x89871fc3aba19e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c27 expref: 10 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044539.350675:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38423a3200/0x89871fc3aba19e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c27 expref: 10 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044539.350685:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38423a3200, rc 0) 00000100:00100000:1.0:1784044539.350761:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39749fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:18093:x1870705565260416:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 192us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044539.350768:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:2.0:1784044539.353602:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044539.353774:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565260544 00000100:00100000:1.0:1784044539.353787:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565260544 00000100:00100000:1.0:1784044539.353859:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:1.0:1784044539.353869:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:18093:x1870705565260544:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784044539.354123:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:18093:x1870705565260544:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 253us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044539.354133:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:0.0:1784044539.362510:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044539.362671:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565260672 00000100:00100000:2.0:1784044539.362684:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565260672 00000100:00100000:2.0:1784044539.362773:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:2.0:1784044539.362785:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:18093:x1870705565260672:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784044539.362998:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:18093:x1870705565260672:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 215us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044539.363007:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:3.0:1784044539.366921:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044539.367055:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565260800 00000100:00100000:2.0:1784044539.367069:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565260800 00000100:00100000:2.0:1784044539.367152:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:2.0:1784044539.367164:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:18116:x1870705565260800:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044539.367685:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:18116:x1870705565260800:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 521us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044539.367696:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:3.0:1784044539.372663:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044539.373978:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565260928 00000100:00100000:1.0:1784044539.373996:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565260928 00000100:00100000:1.0:1784044539.374091:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:1.0:1784044539.374104:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:18116:x1870705565260928:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044539.374388:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:18116:x1870705565260928:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 286us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044539.374399:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:0.0:1784044539.390392:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044539.391641:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:1.0:1784044539.411461:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044539.429508:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565261312 00000100:00100000:2.0:1784044539.429508:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565261056 00000100:00100000:3.0:1784044539.429524:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565261312 00000100:00100000:2.0:1784044539.429524:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565261056 00000100:00100000:3.0:1784044539.430038:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1784044539.430047:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1870705565261312:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784044539.430083:0:22765:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 9e67ce78-1674-4eab-b693-10f988e5915a@192.168.202.40@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:3.0:1784044539.430136:0:22765:0:(genops.c:1406:class_connect()) connect: client 9e67ce78-1674-4eab-b693-10f988e5915a, cookie 0x89871fc3aba19e8e 00000004:00100000:3.0:1784044539.430159:0:22765:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1784044539.431032:0:22765:0:(import.c:65:import_set_state_nolock()) ffff9b397cb24000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044539.431171:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+6:2406:x1870705565261312:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 1121us (39532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044539.431278:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1784044539.431376:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:3.0:1784044539.431383:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1870705565261056:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784044539.431400:0:22765:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 9e67ce78-1674-4eab-b693-10f988e5915a@192.168.202.40@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:3.0:1784044539.431435:0:22765:0:(genops.c:1406:class_connect()) connect: client 9e67ce78-1674-4eab-b693-10f988e5915a, cookie 0x89871fc3aba19e95 00000004:00100000:3.0:1784044539.431925:0:22765:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1784044539.432139:0:22765:0:(import.c:65:import_set_state_nolock()) ffff9b384351c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044539.432383:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+6:2406:x1870705565261056:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 998us (42009us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044539.432392:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:2.0:1784044539.442053:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044539.450988:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044539.451815:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044539.463431:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565261440 00000100:00100000:0.0:1784044539.463446:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565261440 00000100:00100000:0.0:1784044539.463562:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565261568 00000100:00100000:0.0:1784044539.463565:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565261568 00000100:00100000:0.0:1784044539.463580:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565261184 00000100:00100000:0.0:1784044539.463583:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565261184 00000100:00100000:0.0:1784044539.463602:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:0.0:1784044539.463612:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+6:0:x1870705565261440:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044539.463649:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784044539.463744:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+6:0:x1870705565261440:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 133us (21701us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044539.463752:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:0.0:1784044539.463770:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:0.0:1784044539.463776:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+7:18093:x1870705565261568:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044539.463805:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784044539.463835:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+7:18093:x1870705565261568:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 59us (12863us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044539.463841:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:0.0:1784044539.463851:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:0.0:1784044539.463857:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+6:0:x1870705565261184:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044539.463865:0:22765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1784044539.463881:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+6:0:x1870705565261184:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 24us (12075us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044539.463886:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00080000:3.0:1784044539.464888:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044539.464903:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044539.470360:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581124992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044539.470445:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044539.470508:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581124992 00000100:00100000:2.0:1784044539.470516:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581124992 00000100:00100000:2.0:1784044539.470577:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784044539.470588:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581124992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044539.470629:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044539.470674:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581124992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044539.470682:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784044539.470741:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581124992:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784044539.471377:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044539.471513:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581125120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044539.471575:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044539.471610:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044539.471616:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581125248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044539.471639:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044539.471793:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581125120 00000100:00100000:3.0:1784044539.471798:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581125120 00000100:00100000:3.0:1784044539.471839:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581125248 00000100:00100000:3.0:1784044539.471842:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581125248 00000100:00100000:3.0:1784044539.471858:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784044539.471865:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581125120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044539.471886:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1784044539.471928:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581125120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044539.471935:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784044539.471950:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784044539.471966:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581125248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044539.471979:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784044539.472018:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581125248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044539.472024:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784044539.472059:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581125248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044539.472085:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581125120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044539.474987:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044539.475290:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565261696 00000100:00100000:0.0:1784044539.475300:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565261696 00000100:00100000:0.0:1784044539.475376:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1784044539.475387:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+6:18093:x1870705565261696:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784044539.475485:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+6:18093:x1870705565261696:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 99us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044539.475492:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1784044539.488422:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044539.488960:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044539.489010:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044539.489055:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044539.489094:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044539.489237:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565262208 00000100:00100000:1.0:1784044539.489250:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565262208 00000100:00100000:1.0:1784044539.489330:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:1.0:1784044539.489352:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:2407:x1870705565262208:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044539.489454:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:2407:x1870705565262208:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 105us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044539.489463:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:0.0:1784044539.489718:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565261824 00000100:00100000:0.0:1784044539.489746:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565261824 00000100:00100000:0.0:1784044539.489795:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565261952 00000100:00100000:0.0:1784044539.489799:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565261952 00000100:00100000:0.0:1784044539.489824:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1784044539.489832:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1870705565261824:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784044539.489868:0:25382:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 9e67ce78-1674-4eab-b693-10f988e5915a@192.168.202.40@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:0.0:1784044539.489901:0:25382:0:(genops.c:1406:class_connect()) connect: client 9e67ce78-1674-4eab-b693-10f988e5915a, cookie 0x89871fc3aba19e9c 00002000:00100000:0.0:1784044539.489914:0:25382:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9e67ce78-1674-4eab-b693-10f988e5915a/ffff9b3976b44800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784044539.489928:0:25382:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1784044539.490830:0:25382:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784044539.490871:0:25382:0:(import.c:65:import_set_state_nolock()) ffff9b3976b44000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044539.490947:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+6:2406:x1870705565261824:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 1114us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044539.490958:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1784044539.490986:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1784044539.490992:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1870705565261952:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784044539.491797:0:25382:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 9e67ce78-1674-4eab-b693-10f988e5915a@192.168.202.40@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:0.0:1784044539.492171:0:25382:0:(genops.c:1406:class_connect()) connect: client 9e67ce78-1674-4eab-b693-10f988e5915a, cookie 0x89871fc3aba19ea3 00000100:00100000:1.0:1784044539.492325:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565262336 00000100:00100000:1.0:1784044539.492348:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565262336 00000100:00100000:1.0:1784044539.492420:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:1.0:1784044539.492430:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+6:2407:x1870705565262336:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044539.492510:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+6:2407:x1870705565262336:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 81us (3498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044539.492518:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00002000:00100000:0.0:1784044539.492785:0:25382:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9e67ce78-1674-4eab-b693-10f988e5915a/ffff9b3976b42000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784044539.492806:0:25382:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1784044539.497407:0:25382:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784044539.497464:0:25382:0:(import.c:65:import_set_state_nolock()) ffff9b3976b47800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044539.497551:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+6:2406:x1870705565261952:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 6552us (8450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044539.497563:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:2.0:1784044539.504484:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565262080 00000100:00100000:2.0:1784044539.504498:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565262080 00000100:00100000:3.0:1784044539.505275:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1784044539.505285:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9e67ce78-1674-4eab-b693-10f988e5915a+6:18093:x1870705565262080:12345-192.168.202.40@tcp:900:mount.lustre.0 00000100:00100000:3.0:1784044539.505408:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9e67ce78-1674-4eab-b693-10f988e5915a+6:18093:x1870705565262080:12345-192.168.202.40@tcp:900:mount.lustre.0 Request processed in 123us (16996us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044539.505417:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1784044539.509682:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044539.509859:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565262464 00000100:00100000:2.0:1784044539.509871:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565262464 00000100:00100000:2.0:1784044539.509946:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1784044539.509963:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+6:18093:x1870705565262464:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00080000:1.0:1784044539.511551:0:22767:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1481us 00000004:00200000:1.0:1784044539.550323:0:22767:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784044539.550488:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+6:18093:x1870705565262464:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 40522us (40810us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044539.550503:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:1.0:1784044539.748081:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044539.748255:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565262592 00000100:00100000:0.0:1784044539.748265:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565262592 00000100:00100000:0.0:1784044539.748387:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1784044539.748397:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+6:18139:x1870705565262592:12345-192.168.202.40@tcp:101:mkdir.0 00010000:00010000:0.0:1784044539.748417:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044539.748465:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba19eaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6c58 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044539.748529:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19eb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044539.748544:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044539.748559:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044539.748610:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044539.748614:0:22765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044539.748644:0:22765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044539.748673:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba19eaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c58 expref: 8 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044539.748692:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c58 expref: 7 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044539.748699:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758beb00) 00010000:00010000:0.0:1784044539.748702:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044539.748718:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc800, rc 0) 00000100:00100000:0.0:1784044539.748781:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+7:18139:x1870705565262592:12345-192.168.202.40@tcp:101:mkdir.0 Request processed in 385us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044539.748789:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00010000:00010000:1.0:1784044540.429589:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044540.494946:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581125632:0@lo:400:kworker.0 00000100:00100000:3.0:1784044540.495042:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044540.495074:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581126144:0@lo:400:kworker.0 00000100:00100000:3.0:1784044540.495096:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044540.495109:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581126656:0@lo:400:kworker.0 00000100:00100000:3.0:1784044540.495131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044540.495152:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784044540.495169:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581125760:0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.495442:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581125632 00000100:00100000:1.0:1784044540.495450:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581125632 00000100:00100000:1.0:1784044540.495502:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581126144 00000100:00100000:1.0:1784044540.495505:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581126144 00000100:00100000:1.0:1784044540.495520:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044540.495527:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581125632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.495573:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581125632:12345-0@lo:400:kworker.0 Request processed in 46us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.495580:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044540.495598:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044540.495605:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581125376:0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.495606:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581126144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.495639:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581126144:12345-0@lo:400:kworker.0 Request processed in 35us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.495646:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044540.495661:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044540.495668:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044540.495679:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581126656 00000100:00100000:1.0:1784044540.495682:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581126656 00000100:00080000:1.0:1784044540.495696:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044540.495715:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581125888:0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.495731:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784044540.495741:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581126656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044540.495748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044540.495850:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581125504:0@lo:400:kworker.0 00000100:00100000:0.0:1784044540.501702:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581126400:0@lo:400:kworker.0 00000100:00100000:2.0:1784044540.501720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044540.501768:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581126016:0@lo:400:kworker.0 00000100:00100000:0.0:1784044540.501768:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044540.501803:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581126912:0@lo:400:kworker.0 00000100:00100000:2.0:1784044540.501804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044540.501833:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581126528:0@lo:400:kworker.0 00000100:00100000:0.0:1784044540.503743:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044540.503760:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581126656:12345-0@lo:400:kworker.0 Request processed in 8017us (8623us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.503786:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784044540.503845:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581126400 00000100:00100000:1.0:1784044540.503852:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581126400 00000100:00100000:1.0:1784044540.503879:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581126912 00000100:00100000:1.0:1784044540.503881:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581126912 00000100:00100000:1.0:1784044540.503913:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784044540.503920:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581126400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.503984:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581126400:12345-0@lo:400:kworker.0 Request processed in 64us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.503990:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784044540.503999:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044540.504004:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581126912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.504026:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581126912:12345-0@lo:400:kworker.0 Request processed in 22us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.504031:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044540.504046:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581125504 00000100:00100000:1.0:1784044540.504049:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581125504 00000100:00100000:1.0:1784044540.504067:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581126016 00000100:00100000:1.0:1784044540.504070:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581126016 00000100:00100000:1.0:1784044540.504080:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784044540.504085:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581125504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.504110:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581125504:12345-0@lo:400:kworker.0 Request processed in 26us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.504116:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784044540.504124:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784044540.504129:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581126016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.504159:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581126016:12345-0@lo:400:kworker.0 Request processed in 30us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.504164:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1784044540.504194:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044540.504252:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581126400:0@lo:400:kworker.0 00010000:00080000:1.0:1784044540.504265:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39412ead80 x1870705581126912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044540.504275:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581126912:0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.504394:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044540.504402:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581127040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044540.504446:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044540.504487:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581125376 00000100:00100000:1.0:1784044540.504491:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581125376 00000100:00100000:1.0:1784044540.504513:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784044540.504519:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+24:3638:x1870705581125376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.504552:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+24:3638:x1870705581125376:12345-0@lo:400:kworker.0 Request processed in 33us (8894us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.504558:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784044540.504578:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044540.504586:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581127168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044540.504606:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044540.504634:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581125376:0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.504658:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581127040 00000100:00100000:1.0:1784044540.504661:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581127040 00000100:00100000:1.0:1784044540.504680:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581127168 00000100:00100000:1.0:1784044540.504689:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581127168 00000100:00100000:1.0:1784044540.504702:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044540.504707:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1870705581127040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044540.504720:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784044540.504750:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1870705581127040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.504755:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044540.504764:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784044540.504769:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581127168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044540.504790:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784044540.504812:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581127168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.504818:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1784044540.504832:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044540.504849:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581127168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044540.504868:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581127040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044540.505278:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581125888 00000100:00100000:0.0:1784044540.505285:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581125888 00000100:00100000:0.0:1784044540.505340:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784044540.505348:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581125888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044540.505425:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044540.505450:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581126528 00000100:00100000:1.0:1784044540.505455:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581126528 00000100:00100000:2.0:1784044540.505468:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581125504:0@lo:400:kworker.0 00000100:00080000:1.0:1784044540.505474:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044540.505483:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581126016:0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.505514:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044540.505523:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581126528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044540.505560:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044540.505576:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581126528:12345-0@lo:400:kworker.0 Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.505584:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784044540.505593:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581125760 00000100:00100000:3.0:1784044540.505598:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581125760 00000100:00100000:3.0:1784044540.505625:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784044540.505633:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581125760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044540.505667:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581125760:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044540.505672:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784044540.505697:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581125760:0@lo:400:kworker.0 00000100:00100000:3.0:1784044540.505705:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581126272:0@lo:400:kworker.0 00000100:00100000:3.0:1784044540.505726:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044540.505753:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705581126784:0@lo:400:kworker.0 00000100:00100000:3.0:1784044540.505780:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044540.505805:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581125632:0@lo:400:kworker.0 00000100:00100000:3.0:1784044540.505816:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581126144:0@lo:400:kworker.0 00010000:00080000:3.0:1784044540.505829:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39412e8700 x1870705581126656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044540.505838:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581126656:0@lo:400:kworker.0 00000100:00100000:3.0:1784044540.505892:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581126784 00000100:00100000:3.0:1784044540.505895:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581126784 00000100:00100000:3.0:1784044540.505926:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784044540.505932:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705581126784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044540.505965:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705581126784:12345-0@lo:400:kworker.0 Request processed in 33us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044540.505981:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1784044540.505997:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044540.506015:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705581126784:0@lo:400:kworker.0 00000100:00100000:2.0:1784044540.506093:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581126528:0@lo:400:kworker.0 00000100:00100000:0.0:1784044540.506714:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581125888:12345-0@lo:400:kworker.0 Request processed in 1364us (10967us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044540.506723:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784044540.509096:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581126272 00000100:00100000:1.0:1784044540.509358:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581126272 00000100:00100000:1.0:1784044540.509435:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784044540.509447:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3640:x1870705581126272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044540.509561:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3640:x1870705581126272:12345-0@lo:400:kworker.0 Request processed in 116us (3832us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044540.509569:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784044540.509708:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581125888:0@lo:400:kworker.0 00000100:00100000:2.0:1784044540.509770:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581126272:0@lo:400:kworker.0 00000001:00100000:3.0:1784044541.010423:0:25091:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e67ce78-1674-4eab-b693-10f988e5915a 00000001:00080000:3.0:1784044541.010441:0:25091:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1784044541.453817:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044541.517597:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044541.517620:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581127296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044541.517686:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044541.517993:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581127296 00000100:00100000:1.0:1784044541.518000:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581127296 00000100:00100000:1.0:1784044541.518270:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784044541.518280:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581127296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044541.518394:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044541.518453:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581127296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044541.518460:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044541.518537:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581127296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044541.849440:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044541.849639:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565262720 00000100:00100000:1.0:1784044541.849653:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565262720 00000100:00100000:1.0:1784044541.849755:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:1.0:1784044541.849767:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+7:18191:x1870705565262720:12345-192.168.202.40@tcp:41:lfs.0 00000100:00080000:3.0:1784044541.849842:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1784044541.849908:0:24585:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1784044541.850093:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+7:18191:x1870705565262720:12345-192.168.202.40@tcp:41:lfs.0 Request processed in 329us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044541.850100:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:3.0:1784044541.860964:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044541.861160:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565262848 00000100:00100000:1.0:1784044541.861186:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565262848 00000100:00100000:1.0:1784044541.861284:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:1.0:1784044541.861297:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+6:18191:x1870705565262848:12345-192.168.202.40@tcp:41:lfs.0 00000004:00000024:1.0:1784044541.861358:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784044541.861479:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+6:18191:x1870705565262848:12345-192.168.202.40@tcp:41:lfs.0 Request processed in 186us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044541.861485:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00080000:3.0:1784044541.861890:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044541.864431:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044541.864632:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565262976 00000100:00100000:2.0:1784044541.864644:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565262976 00000100:00100000:2.0:1784044541.864738:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:2.0:1784044541.864752:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e67ce78-1674-4eab-b693-10f988e5915a+6:18191:x1870705565262976:12345-192.168.202.40@tcp:13:lfs.0 00002000:00000024:2.0:1784044541.864803:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044541.864962:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e67ce78-1674-4eab-b693-10f988e5915a+6:18191:x1870705565262976:12345-192.168.202.40@tcp:13:lfs.0 Request processed in 214us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044541.864973:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00080000:3.0:1784044541.865567:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044541.871466:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044541.873528:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565263104 00000100:00100000:1.0:1784044541.873557:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565263104 00000100:00080000:3.0:1784044541.873655:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044541.873683:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:1.0:1784044541.873697:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e67ce78-1674-4eab-b693-10f988e5915a+5:18191:x1870705565263104:12345-192.168.202.40@tcp:13:lfs.0 00002000:00000024:1.0:1784044541.873745:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784044541.873870:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e67ce78-1674-4eab-b693-10f988e5915a+5:18191:x1870705565263104:12345-192.168.202.40@tcp:13:lfs.0 Request processed in 176us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044541.873880:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:0.0:1784044542.061997:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044542.062268:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565263232 00000100:00100000:1.0:1784044542.062283:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565263232 00000100:00100000:1.0:1784044542.062376:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:1.0:1784044542.062390:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+10:18223:x1870705565263232:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784044542.062412:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044542.062438:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38423a3800/0x89871fc3aba19eb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6c5f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044542.062478:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38423a3800/0x89871fc3aba19eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c5f expref: 11 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044542.062492:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38423a3800/0x89871fc3aba19eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c5f expref: 11 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044542.062505:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38423a3800, rc 0) 00000100:00100000:1.0:1784044542.062580:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18223:x1870705565263232:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 193us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044542.062605:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:3.0:1784044542.079560:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044542.079741:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565263360 00000100:00100000:1.0:1784044542.079753:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565263360 00000100:00100000:1.0:1784044542.079829:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:1.0:1784044542.079842:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39818ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18223:x1870705565263360:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784044542.080072:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39818ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18223:x1870705565263360:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 232us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044542.080081:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:2.0:1784044542.085565:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044542.085725:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565263488 00000100:00100000:1.0:1784044542.085738:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565263488 00000100:00100000:1.0:1784044542.085820:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:1.0:1784044542.085832:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18223:x1870705565263488:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784044542.089883:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18223:x1870705565263488:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 4036us (4317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044542.089902:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:0.0:1784044542.109270:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044542.109503:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565263616 00000100:00100000:1.0:1784044542.109517:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565263616 00000100:00100000:1.0:1784044542.109587:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:1.0:1784044542.109596:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18230:x1870705565263616:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044542.109753:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18230:x1870705565263616:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 158us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044542.109761:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:3.0:1784044542.129502:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044542.129831:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565263744 00000100:00100000:0.0:1784044542.129861:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565263744 00000100:00100000:0.0:1784044542.129935:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:0.0:1784044542.129947:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18230:x1870705565263744:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044542.130209:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18230:x1870705565263744:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 226us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044542.130219:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:2.0:1784044542.137515:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044542.137979:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565263872 00000100:00100000:1.0:1784044542.137993:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565263872 00000100:00100000:1.0:1784044542.138079:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:1.0:1784044542.138091:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18230:x1870705565263872:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044542.138549:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18230:x1870705565263872:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 458us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044542.138568:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:1.0:1784044542.143958:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044542.144691:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565264000 00000100:00100000:2.0:1784044542.144706:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565264000 00000100:00100000:2.0:1784044542.144884:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:2.0:1784044542.144896:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18223:x1870705565264000:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784044542.144921:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044542.144946:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798a00/0x89871fc3aba19ebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6c90 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044542.144985:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798a00/0x89871fc3aba19ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c90 expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044542.144998:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798a00/0x89871fc3aba19ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c90 expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044542.145009:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798a00, rc 0) 00000100:00100000:2.0:1784044542.145114:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:18223:x1870705565264000:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 220us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044542.145124:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:3.0:1784044542.147809:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044542.148581:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565264128 00000100:00100000:1.0:1784044542.148598:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565264128 00000100:00100000:1.0:1784044542.148677:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:1.0:1784044542.148691:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:18223:x1870705565264128:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:1.0:1784044542.148734:0:22758:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784044542.148850:0:22758:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784044542.148856:0:22758:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784044542.148860:0:22758:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784044542.148864:0:22758:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1784044542.148867:0:22758:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1784044542.151138:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:18223:x1870705565264128:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 2432us (3326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044542.151156:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:3.0:1784044542.153978:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044542.154152:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565264256 00000100:00100000:2.0:1784044542.154165:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565264256 00000100:00100000:2.0:1784044542.154264:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:2.0:1784044542.154276:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:18223:x1870705565264256:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784044542.154327:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044542.154353:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843799400/0x89871fc3aba19ec6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6c97 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044542.154393:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843799400/0x89871fc3aba19ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c97 expref: 13 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044542.154408:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843799400/0x89871fc3aba19ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c97 expref: 13 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044542.154419:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799400, rc 0) 00000100:00100000:2.0:1784044542.154493:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18223:x1870705565264256:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 219us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044542.154502:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:3.0:1784044542.156627:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044542.156733:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565264384 00000100:00100000:2.0:1784044542.156743:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565264384 00000100:00100000:2.0:1784044542.156804:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:2.0:1784044542.156814:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18223:x1870705565264384:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784044542.157012:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18223:x1870705565264384:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 198us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044542.157021:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:3.0:1784044542.159011:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044542.159139:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565264512 00000100:00100000:0.0:1784044542.159151:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565264512 00000100:00100000:0.0:1784044542.159249:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:0.0:1784044542.159261:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18223:x1870705565264512:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784044542.159470:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18223:x1870705565264512:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 210us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044542.159480:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:3.0:1784044542.162611:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044542.162850:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565264640 00000100:00100000:1.0:1784044542.162863:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565264640 00000100:00100000:1.0:1784044542.162941:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:1.0:1784044542.162952:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18233:x1870705565264640:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044542.163161:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18233:x1870705565264640:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 210us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044542.163171:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:3.0:1784044542.170277:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044542.170477:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565264768 00000100:00100000:2.0:1784044542.170491:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565264768 00000100:00100000:2.0:1784044542.170577:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:2.0:1784044542.170589:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18233:x1870705565264768:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044542.170809:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18233:x1870705565264768:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 220us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044542.170825:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:3.0:1784044542.182842:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044542.183020:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044542.183523:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565264896 00000100:00100000:0.0:1784044542.183546:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565264896 00000100:00100000:1.0:1784044542.183686:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565265152 00000100:00100000:1.0:1784044542.183691:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565265152 00000100:00100000:1.0:1784044542.183736:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1784044542.183746:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1870705565264896:12345-192.168.202.40@tcp:38:mount.lustre.0 00000100:00100000:3.0:1784044542.183863:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:3.0:1784044542.183876:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1870705565265152:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784044542.183914:0:22764:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 73e036a9-673f-4154-85f2-09160098f67f@192.168.202.40@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:3.0:1784044542.183963:0:22764:0:(genops.c:1406:class_connect()) connect: client 73e036a9-673f-4154-85f2-09160098f67f, cookie 0x89871fc3aba19ecd 00000004:00100000:3.0:1784044542.183999:0:22764:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1784044542.184194:0:22764:0:(import.c:65:import_set_state_nolock()) ffff9b3843518000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1784044542.184378:0:24585:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 73e036a9-673f-4154-85f2-09160098f67f@192.168.202.40@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:1.0:1784044542.184409:0:24585:0:(genops.c:1406:class_connect()) connect: client 73e036a9-673f-4154-85f2-09160098f67f, cookie 0x89871fc3aba19ed4 00000100:00100000:3.0:1784044542.185706:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73e036a9-673f-4154-85f2-09160098f67f+6:2406:x1870705565265152:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 1815us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044542.185722:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000004:00100000:1.0:1784044542.186773:0:24585:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1784044542.186925:0:24585:0:(import.c:65:import_set_state_nolock()) ffff9b3974957000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044542.187023:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73e036a9-673f-4154-85f2-09160098f67f+6:2406:x1870705565264896:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 3275us (4196us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044542.187035:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1784044542.192882:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044542.193115:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565265280 00000100:00100000:1.0:1784044542.193129:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565265280 00000100:00100000:1.0:1784044542.193252:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1784044542.193262:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73e036a9-673f-4154-85f2-09160098f67f+6:0:x1870705565265280:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784044542.193290:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1784044542.193497:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044542.193702:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73e036a9-673f-4154-85f2-09160098f67f+6:0:x1870705565265280:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 440us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044542.193712:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:2.0:1784044542.196767:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044542.196907:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044542.197997:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565265408 00000100:00100000:1.0:1784044542.198013:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565265408 00000100:00100000:1.0:1784044542.198126:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565265024 00000100:00100000:1.0:1784044542.198130:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565265024 00000100:00100000:1.0:1784044542.198158:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1784044542.198169:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73e036a9-673f-4154-85f2-09160098f67f+7:18223:x1870705565265408:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784044542.198233:0:24585:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00080000:0.0:1784044542.198363:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044542.198389:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1784044542.198399:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73e036a9-673f-4154-85f2-09160098f67f+7:0:x1870705565265024:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044542.198415:0:22766:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1784044542.198500:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73e036a9-673f-4154-85f2-09160098f67f+7:18223:x1870705565265408:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 333us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044542.198509:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1784044542.201439:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73e036a9-673f-4154-85f2-09160098f67f+6:0:x1870705565265024:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 3023us (4512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044542.201460:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1784044542.205843:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044542.206090:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565265536 00000100:00100000:1.0:1784044542.206107:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565265536 00000100:00100000:1.0:1784044542.206256:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:1.0:1784044542.206268:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73e036a9-673f-4154-85f2-09160098f67f+6:18223:x1870705565265536:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784044542.206408:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73e036a9-673f-4154-85f2-09160098f67f+6:18223:x1870705565265536:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 142us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044542.206417:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1784044542.210430:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044542.210487:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044542.210581:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044542.210706:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565265664 00000100:00100000:2.0:1784044542.210719:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565265664 00000100:00100000:2.0:1784044542.210784:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565265792 00000100:00100000:2.0:1784044542.210788:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565265792 00000100:00100000:2.0:1784044542.210812:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1784044542.210822:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1870705565265664:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784044542.210870:0:24275:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 73e036a9-673f-4154-85f2-09160098f67f@192.168.202.40@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:2.0:1784044542.210914:0:24275:0:(genops.c:1406:class_connect()) connect: client 73e036a9-673f-4154-85f2-09160098f67f, cookie 0x89871fc3aba19edb 00002000:00100000:2.0:1784044542.210931:0:24275:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 73e036a9-673f-4154-85f2-09160098f67f/ffff9b3844597800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784044542.210946:0:24275:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1784044542.211046:0:24275:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784044542.211090:0:24275:0:(import.c:65:import_set_state_nolock()) ffff9b3844597000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044542.211221:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:73e036a9-673f-4154-85f2-09160098f67f+6:2406:x1870705565265664:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 398us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044542.211230:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1784044542.211252:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1784044542.211257:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1870705565265792:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784044542.211275:0:24275:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 73e036a9-673f-4154-85f2-09160098f67f@192.168.202.40@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:2.0:1784044542.211331:0:24275:0:(genops.c:1406:class_connect()) connect: client 73e036a9-673f-4154-85f2-09160098f67f, cookie 0x89871fc3aba19ee2 00002000:00100000:2.0:1784044542.211338:0:24275:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 73e036a9-673f-4154-85f2-09160098f67f/ffff9b3844595000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784044542.211346:0:24275:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1784044542.211411:0:24275:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784044542.211428:0:24275:0:(import.c:65:import_set_state_nolock()) ffff9b3844590800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044542.211455:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:73e036a9-673f-4154-85f2-09160098f67f+6:2406:x1870705565265792:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 196us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044542.211463:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1784044542.211623:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565265920 00000100:00100000:0.0:1784044542.211630:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565265920 00000100:00100000:0.0:1784044542.211685:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:0.0:1784044542.211693:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:73e036a9-673f-4154-85f2-09160098f67f+6:18223:x1870705565265920:12345-192.168.202.40@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784044542.211746:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:73e036a9-673f-4154-85f2-09160098f67f+6:18223:x1870705565265920:12345-192.168.202.40@tcp:900:mount.lustre.0 Request processed in 54us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044542.211753:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:3.0:1784044542.217335:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044542.217553:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565266048 00000100:00100000:1.0:1784044542.217565:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565266048 00000100:00100000:1.0:1784044542.217631:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1784044542.217641:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:73e036a9-673f-4154-85f2-09160098f67f+6:18223:x1870705565266048:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00200000:1.0:1784044542.217753:0:22768:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784044542.217876:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:73e036a9-673f-4154-85f2-09160098f67f+6:18223:x1870705565266048:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 234us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044542.217884:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:3.0:1784044542.360386:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044542.360681:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565266176 00000100:00100000:0.0:1784044542.360695:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565266176 00000100:00100000:0.0:1784044542.360785:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1784044542.360798:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73e036a9-673f-4154-85f2-09160098f67f+6:18256:x1870705565266176:12345-192.168.202.40@tcp:101:mkdir.0 00010000:00010000:0.0:1784044542.360830:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044542.360859:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba19ee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6cc8 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044542.360940:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044542.360953:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044542.360965:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044542.361017:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044542.361020:0:22765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044542.361039:0:22765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044542.361066:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba19ee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cc8 expref: 8 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044542.361088:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cc8 expref: 7 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044542.361117:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758beb00) 00010000:00010000:0.0:1784044542.361120:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044542.361123:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd200, rc 0) 00000100:00100000:0.0:1784044542.361251:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73e036a9-673f-4154-85f2-09160098f67f+7:18256:x1870705565266176:12345-192.168.202.40@tcp:101:mkdir.0 Request processed in 455us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044542.361259:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00010000:00010000:1.0:1784044542.477450:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044543.501624:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044544.526940:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044544.589910:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581127424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044544.589989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044544.590152:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581127424 00000100:00100000:1.0:1784044544.590160:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581127424 00000100:00100000:3.0:1784044544.590303:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044544.590314:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581127552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044544.590357:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784044544.590368:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581127424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044544.590400:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784044544.590445:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044544.590501:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581127424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044544.590527:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581127552 00000100:00100000:1.0:1784044544.590530:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581127424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044544.590531:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581127552 00000100:00100000:1.0:1784044544.590544:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1784044544.590570:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044544.590575:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784044544.590582:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581127552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044544.590610:0:23783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784044544.590652:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581127552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044544.590664:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784044544.590777:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581127552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044544.591646:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581127680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044544.591706:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044544.593034:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581127680 00000100:00100000:1.0:1784044544.593044:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581127680 00000100:00100000:1.0:1784044544.593096:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784044544.593105:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581127680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044544.593138:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1784044544.593243:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581127680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044544.593251:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784044544.593410:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581127680:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1784044544.593607:0:22744:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 73e036a9-673f-4154-85f2-09160098f67f 00000001:00100000:1.0:1784044544.593618:0:22744:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9e67ce78-1674-4eab-b693-10f988e5915a 00000001:00100000:2.0:1784044544.594367:0:24271:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 73e036a9-673f-4154-85f2-09160098f67f 00000001:00100000:2.0:1784044544.594376:0:24271:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9e67ce78-1674-4eab-b693-10f988e5915a 00000001:00100000:2.0:1784044544.597764:0:23500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 73e036a9-673f-4154-85f2-09160098f67f 00000001:00100000:2.0:1784044544.597778:0:23500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9e67ce78-1674-4eab-b693-10f988e5915a 00000040:00080000:2.0:1784044545.433140:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1784044545.514741:0:25648:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1784044545.550774:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044545.614653:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581127808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044545.614727:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.614796:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581127936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044545.614823:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.614856:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581127808 00000100:00100000:1.0:1784044545.614863:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581127808 00000100:00100000:1.0:1784044545.614909:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581127936 00000100:00100000:1.0:1784044545.614912:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581127936 00000100:00100000:1.0:1784044545.614930:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784044545.614938:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581127808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044545.614968:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784044545.615012:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581127808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.615047:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784044545.615066:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784044545.615072:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581127936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044545.615083:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1784044545.615113:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581127936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.615120:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1784044545.615140:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044545.616534:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581127936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044545.616560:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581128448:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.616651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.616689:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581128960:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.616722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.616905:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784044545.616913:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581128064:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.616945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.616974:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581128576:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.616998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.617017:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581129088:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.617113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.617145:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581128448 00000100:00100000:1.0:1784044545.617151:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581128448 00000100:00100000:1.0:1784044545.617224:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581128960 00000100:00100000:1.0:1784044545.617228:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581128960 00000100:00100000:1.0:1784044545.617250:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581129088 00000100:00100000:1.0:1784044545.617260:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581129088 00000100:00100000:1.0:1784044545.617308:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784044545.617317:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581128448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.617363:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581128448:12345-0@lo:400:kworker.0 Request processed in 47us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.617370:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784044545.617386:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784044545.617392:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581128960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.617421:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581128960:12345-0@lo:400:kworker.0 Request processed in 30us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.617428:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784044545.617439:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044545.617444:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581129088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.617470:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581129088:12345-0@lo:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.617476:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044545.617493:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581128576 00000100:00100000:1.0:1784044545.617496:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581128576 00000100:00100000:1.0:1784044545.617520:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784044545.617526:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581128576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.617557:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581128576:12345-0@lo:400:kworker.0 Request processed in 32us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.617562:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1784044545.617585:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044545.617587:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044545.617609:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581128576:0@lo:400:kworker.0 00010000:00080000:1.0:1784044545.617632:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397a8a4000 x1870705581129088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044545.617644:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581129088:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.617655:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581128448:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.617664:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581128960:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.617688:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581128320:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.617714:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.617735:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581128832:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.618617:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.618640:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581129344:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.618662:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.618687:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1784044545.618709:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581127808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044545.618723:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784044545.618729:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581128192:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.618826:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.618846:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581128704:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.618867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.618886:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705581129216:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.618911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044545.618943:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581128320 00000100:00100000:1.0:1784044545.618948:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581128320 00000100:00100000:1.0:1784044545.618987:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581128704 00000100:00100000:1.0:1784044545.618999:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581128704 00000100:00100000:1.0:1784044545.619022:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784044545.619028:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581128320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.619068:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581128320:12345-0@lo:400:kworker.0 Request processed in 40us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.619074:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784044545.619088:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044545.619093:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581128704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.619119:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581128704:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.619125:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044545.619142:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581128832 00000100:00100000:1.0:1784044545.619146:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581128832 00000100:00100000:1.0:1784044545.619161:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581129344 00000100:00100000:1.0:1784044545.619163:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581129344 00000100:00100000:1.0:1784044545.619194:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581129216 00000100:00100000:1.0:1784044545.619197:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581129216 00000100:00100000:1.0:1784044545.619212:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784044545.619218:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581128832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.619251:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581128832:12345-0@lo:400:kworker.0 Request processed in 33us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.619257:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784044545.619268:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784044545.619273:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705581129344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.619310:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705581129344:12345-0@lo:400:kworker.0 Request processed in 37us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.619316:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784044545.619446:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784044545.619455:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705581129216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.619484:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705581129216:12345-0@lo:400:kworker.0 Request processed in 31us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.619490:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784044545.619513:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581128192 00000100:00100000:1.0:1784044545.619516:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581128192 00000100:00100000:1.0:1784044545.619540:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784044545.619546:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581128192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.619576:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581128192:12345-0@lo:400:kworker.0 Request processed in 31us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.619582:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1784044545.619614:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044545.619617:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044545.619620:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044545.619642:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581128192:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.619652:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581128704:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.619660:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705581129216:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.619670:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581128320:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.619677:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581128832:0@lo:400:kworker.0 00010000:00080000:1.0:1784044545.619688:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397a8a5f80 x1870705581129344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044545.619698:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581129344:0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.621875:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581128064 00000100:00100000:1.0:1784044545.621894:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581128064 00000100:00100000:1.0:1784044545.622088:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784044545.622098:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+24:3638:x1870705581128064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044545.622202:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+24:3638:x1870705581128064:12345-0@lo:400:kworker.0 Request processed in 105us (5255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044545.622210:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784044545.622303:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581128064:0@lo:400:kworker.0 00010000:00010000:1.0:1784044546.575539:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044546.638392:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581129472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044546.638463:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044546.638564:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581129472 00000100:00100000:2.0:1784044546.638576:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581129472 00000100:00100000:2.0:1784044546.638658:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784044546.638675:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581129472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044546.638716:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044546.638814:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581129472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044546.638823:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784044546.638877:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581129472:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1784044547.089908:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784044547.319413:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044547.319469:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565266304 00000100:00100000:2.0:1784044547.319471:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044547.319480:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565266304 00000100:00100000:2.0:1784044547.319506:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044547.319530:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044547.319535:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:1.0:1784044547.319546:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:2407:x1870705565266304:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044547.319554:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044547.319574:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044547.319628:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:2407:x1870705565266304:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044547.319636:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:2.0:1784044547.320349:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044547.320382:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044547.320546:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565266816 00000100:00100000:0.0:1784044547.320552:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565266816 00000100:00100000:0.0:1784044547.320595:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565267328 00000100:00100000:0.0:1784044547.320598:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565267328 00000100:00100000:0.0:1784044547.320613:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565266688 00000100:00100000:0.0:1784044547.320615:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565266688 00000100:00100000:0.0:1784044547.320629:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1784044547.320637:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+5:2407:x1870705565266816:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044547.320776:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044547.320798:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565266560 00000100:00100000:2.0:1784044547.320802:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565266560 00000100:00100000:2.0:1784044547.320829:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565267072 00000100:00100000:2.0:1784044547.320832:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565267072 00000100:00100000:0.0:1784044547.321098:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+5:2407:x1870705565266816:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 461us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044547.321107:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1784044547.321124:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565267200 00000100:00100000:0.0:1784044547.321127:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565267200 00000100:00100000:0.0:1784044547.321148:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1784044547.321155:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73e036a9-673f-4154-85f2-09160098f67f+6:2407:x1870705565267328:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044547.321199:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73e036a9-673f-4154-85f2-09160098f67f+6:2407:x1870705565267328:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 45us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044547.321205:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1784044547.321223:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1784044547.321228:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+5:2407:x1870705565266688:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044547.321251:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+5:2407:x1870705565266688:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044547.321257:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1784044547.321279:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:0.0:1784044547.321287:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b396ee06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73e036a9-673f-4154-85f2-09160098f67f+5:2407:x1870705565267200:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044547.321309:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b396ee06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73e036a9-673f-4154-85f2-09160098f67f+5:2407:x1870705565267200:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044547.321314:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00080000:0.0:1784044547.321453:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044547.321509:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565266432 00000100:00100000:2.0:1784044547.321512:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565266432 00000100:00100000:2.0:1784044547.321523:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565266944 00000100:00100000:2.0:1784044547.321525:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565266944 00000100:00100000:2.0:1784044547.321536:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00080000:0.0:1784044547.321557:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044547.321561:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784044547.321564:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044547.321596:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+5:2407:x1870705565266560:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044547.321731:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+5:2407:x1870705565266560:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 188us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044547.321740:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:2.0:1784044547.321754:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:2.0:1784044547.321761:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73e036a9-673f-4154-85f2-09160098f67f+5:2407:x1870705565267072:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044547.321786:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73e036a9-673f-4154-85f2-09160098f67f+5:2407:x1870705565267072:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044547.321793:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:2.0:1784044547.321804:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:2.0:1784044547.321811:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+6:2407:x1870705565266432:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044547.321831:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+6:2407:x1870705565266432:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044547.321837:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:2.0:1784044547.321870:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:2.0:1784044547.321876:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73e036a9-673f-4154-85f2-09160098f67f+6:2407:x1870705565266944:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044547.321899:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73e036a9-673f-4154-85f2-09160098f67f+6:2407:x1870705565266944:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044547.321904:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00010000:00010000:1.0:1784044547.597542:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784044547.662599:0:25091:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 73e036a9-673f-4154-85f2-09160098f67f 00010000:00010000:1.0:1784044548.631445:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044549.645813:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044549.709443:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581129600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044549.709522:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044549.710598:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581129600 00000100:00100000:1.0:1784044549.710609:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581129600 00000100:00100000:1.0:1784044549.710669:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044549.710678:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581129600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044549.710719:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044549.710797:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581129600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044549.710813:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1784044549.710868:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044549.710883:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581129728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044549.710958:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044549.713866:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581129856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044549.714503:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044549.714570:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581129728 00000100:00100000:1.0:1784044549.714578:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581129728 00000100:00100000:1.0:1784044549.714642:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581129856 00000100:00100000:1.0:1784044549.714645:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581129856 00000100:00100000:1.0:1784044549.714663:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784044549.714672:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581129728:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044549.715116:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784044549.715127:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581129856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044549.715151:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1784044549.715777:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581129856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 650us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044549.715786:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000004:00000024:1.0:1784044549.716032:0:22770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784044549.716039:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581129856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044549.716498:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581129600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044549.723841:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581129728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9160us (12872us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044549.723858:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784044549.728487:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581129728:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1784044549.748440:0:25796:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec3bc6b40 20000000:00000080:2.0:1784044549.748460:0:25796:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b39657cdc00 uarg=0000000000000000 20000000:01000000:2.0:1784044549.748507:0:25796:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784044549.748513:0:25796:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784044549.748518:0:25796:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784044549.751493:0:25797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1784044549.751700:0:25796:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784044549.759165:0:25796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784044549.759225:0:25796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.759256:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38410b7000/0x89871fc3aba19b54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19b4d expref: 23 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.759264:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19b62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19b5b expref: 23 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.759271:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ba1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19b9a expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.759278:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19d22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19d1b expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.759288:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38423a3200/0x89871fc3aba19e87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c27 expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.760046:0:25796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3843799400/0x89871fc3aba19ec6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c97 expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.760121:0:25796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.760170:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3843799400/0x89871fc3aba19ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c97 expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.760209:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3843799400/0x89871fc3aba19ec6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c97 expref: 12 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044549.760224:0:25796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581129984:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044549.761293:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38423a3200/0x89871fc3aba19e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c27 expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.761306:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38423a3200/0x89871fc3aba19e87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c27 expref: 12 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044549.761393:0:25796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581130112:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044549.761435:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19d1b expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.761445:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19d22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19d1b expref: 23 pid: 22759 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044549.761454:0:25796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581130240:0@lo:104: 00000100:00100000:3.0:1784044549.767385:0:25796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044549.767711:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581130240 00000100:00100000:1.0:1784044549.767720:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581130240 00010000:00010000:3.0:1784044549.767777:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19b9a expref: 23 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044549.767793:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1784044549.767796:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ba1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19b9a expref: 23 pid: 22759 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044549.767807:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:25796:x1870705581130240:12345-0@lo:104: 00000100:00100000:3.0:1784044549.767814:0:25796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581130368:0@lo:104: 00010000:00010000:1.0:1784044549.767826:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044549.767874:0:25796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784044549.767895:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1784044549.767901:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19b62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19b5b expref: 23 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044549.767907:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:25796:x1870705581130240:12345-0@lo:104: Request processed in 101us (526us total) trans 0 rc 0/0 00010000:00010000:3.0:1784044549.767916:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19b62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19b5b expref: 23 pid: 22758 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044549.767922:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784044549.767929:0:25796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581130496:0@lo:104: 00000100:00100000:3.0:1784044549.767952:0:25796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044549.767974:0:25796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38410b7000/0x89871fc3aba19b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19b4d expref: 23 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.767982:0:25796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38410b7000/0x89871fc3aba19b54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19b4d expref: 23 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044549.767984:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581130368 00000100:00100000:1.0:1784044549.767989:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581130368 00000100:00100000:3.0:1784044549.767996:0:25796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581130624:0@lo:104: 00000100:00100000:1.0:1784044549.768007:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581130496 00000100:00100000:1.0:1784044549.768011:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581130496 00000100:00100000:3.0:1784044549.768020:0:25796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044549.768030:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581130624 00000100:00100000:3.0:1784044549.768035:0:25796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044549.768035:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581130624 00000100:00100000:1.0:1784044549.768057:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784044549.768062:0:25796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581129984:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044549.768066:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+5:25796:x1870705581130368:12345-0@lo:104: 00010000:00010000:1.0:1784044549.768076:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768117:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784044549.768123:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+5:25796:x1870705581130368:12345-0@lo:104: Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044549.768129:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784044549.768144:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784044549.768152:0:25796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581130240:0@lo:104: 00000100:00100000:1.0:1784044549.768153:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+4:25796:x1870705581130496:12345-0@lo:104: 00000100:00100000:3.0:1784044549.768166:0:25796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581130368:0@lo:104: 00010000:00010000:1.0:1784044549.768168:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768266:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784044549.768274:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+4:25796:x1870705581130496:12345-0@lo:104: Request processed in 122us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044549.768281:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044549.768294:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784044549.768299:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:25796:x1870705581130624:12345-0@lo:104: 00010000:00010000:1.0:1784044549.768306:0:22747:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768353:0:22747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784044549.768358:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccdc2386-7f06-47a4-81d1-1145948bf326+3:25796:x1870705581130624:12345-0@lo:104: Request processed in 59us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044549.768363:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1784044549.768380:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784044549.768385:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768394:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044549.768400:0:23922:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044549.768404:0:25796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581130496:0@lo:104: 00010000:00010000:1.0:1784044549.768413:0:23922:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044549.768423:0:23922:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044549.768426:0:25796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581130624:0@lo:104: 10000000:01000000:1.0:1784044549.768436:0:23922:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784044549.768487:0:23922:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768494:0:23922:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044549.768525:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768535:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b397cb19400/0x89871fc3aba19d1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19d22 expref: -99 pid: 25090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044549.768545:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:1.0:1784044549.768565:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784044549.768569:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768574:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19800 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044549.768577:0:23922:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768584:0:23922:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044549.768591:0:23922:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044549.768720:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581130752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044549.768747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1784044549.768807:0:23922:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784044549.768824:0:23922:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768832:0:23922:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784044549.768847:0:25796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25796:1870705581130112:192.168.202.40@tcp:104: 00010000:00010000:1.0:1784044549.768849:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768858:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b397cb19800/0x89871fc3aba19b9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19ba1 expref: -99 pid: 24270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768870:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044549.768873:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.768881:0:25796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768904:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3940031e00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044549.768908:0:23922:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768916:0:23922:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044549.768925:0:23922:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044549.768932:0:23922:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784044549.768948:0:23922:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.768954:0:23922:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784044549.769079:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581131008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044549.769111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784044549.769495:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.769503:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3940031e00/0x89871fc3aba19b5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b62 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.769515:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044549.769518:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.769524:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586eea00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044549.769527:0:23922:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.769544:0:23922:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044549.769549:0:23922:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044549.769565:0:23922:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784044549.769589:0:23922:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044549.769619:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565267456 00000100:00100000:3.0:1784044549.769624:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565267456 00010000:00010000:3.0:1784044549.769648:0:25108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3843799400/0x89871fc3aba19ec6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c97 expref: 13 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044549.769671:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581130752 00000100:00100000:3.0:1784044549.769674:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581130752 00010000:00010000:3.0:1784044549.769686:0:25108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19d22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19d1b expref: 24 pid: 22759 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044549.769697:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581131008 00000100:00100000:3.0:1784044549.769699:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581131008 00010000:00010000:3.0:1784044549.769708:0:25108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19b62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19b5b expref: 25 pid: 22758 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044549.769721:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1784044549.769727:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:2409:x1870705565267456:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044549.769740:0:25108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044549.769746:0:25108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3843799400/0x89871fc3aba19ec6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c97 expref: 13 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.769757:0:25108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3843799400/0x89871fc3aba19ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c97 expref: 13 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.769780:0:25108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843799400/0x89871fc3aba19ec6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c97 expref: 13 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.769793:0:25108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044549.769833:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:2409:x1870705565267456:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 106us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044549.769841:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1784044549.769859:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784044549.769865:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccdc2386-7f06-47a4-81d1-1145948bf326+25:3638:x1870705581130752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044549.769873:0:25108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044549.769878:0:25108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19d22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19d1b expref: 25 pid: 22759 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.769886:0:25108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19d1b expref: 25 pid: 22759 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.769896:0:25108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19d22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19d1b expref: 25 pid: 22759 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.769905:0:25108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044549.769929:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccdc2386-7f06-47a4-81d1-1145948bf326+24:3638:x1870705581130752:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044549.769936:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784044549.769948:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784044549.769955:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccdc2386-7f06-47a4-81d1-1145948bf326+23:3640:x1870705581131008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044549.769962:0:25108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044549.769966:0:25108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19b62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19b5b expref: 23 pid: 22758 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.769981:0:25108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19b62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19b5b expref: 23 pid: 22758 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.769991:0:25108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19b62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19b5b expref: 23 pid: 22758 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.769999:0:25108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044549.770239:0:23922:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784044549.776587:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccdc2386-7f06-47a4-81d1-1145948bf326+22:3640:x1870705581131008:12345-0@lo:103:ldlm_bl.0 Request processed in 6619us (7461us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044549.776607:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1784044549.777142:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.777155:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba19b4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19b54 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044549.777196:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044549.777200:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044549.777203:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044549.777213:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044549.777222:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044549.777285:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581130752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044549.777311:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044549.777323:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581130880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044549.777390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044549.779442:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581131008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044549.779471:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044549.779481:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581131136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044549.780568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044549.781206:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044549.781352:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581130880 00000100:00100000:2.0:1784044549.781361:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581130880 00010000:00010000:2.0:1784044549.781396:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ba1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19b9a expref: 22 pid: 22759 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044549.781424:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581131136 00000100:00100000:2.0:1784044549.781427:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581131136 00010000:00010000:2.0:1784044549.781437:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38410b7000/0x89871fc3aba19b54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19b4d expref: 23 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044549.781446:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565267584 00000100:00100000:2.0:1784044549.781448:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565267584 00010000:00010000:2.0:1784044549.781458:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38423a3200/0x89871fc3aba19e87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c27 expref: 12 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044549.781469:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044549.781584:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+23:3638:x1870705581130880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044549.781602:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044549.781608:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ba1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19b9a expref: 23 pid: 22759 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781618:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19b9a expref: 23 pid: 22759 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781635:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940030e00/0x89871fc3aba19ba1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19b9a expref: 23 pid: 22759 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781649:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044549.781690:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+22:3638:x1870705581130880:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (4302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044549.781698:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044549.781714:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044549.781721:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+21:3640:x1870705581131136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044549.781729:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044549.781733:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38410b7000/0x89871fc3aba19b54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19b4d expref: 21 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781740:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38410b7000/0x89871fc3aba19b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19b4d expref: 21 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781750:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7000/0x89871fc3aba19b54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19b4d expref: 21 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781759:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044549.781787:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccdc2386-7f06-47a4-81d1-1145948bf326+20:3640:x1870705581131136:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044549.781801:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044549.781841:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:2.0:1784044549.781848:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:2410:x1870705565267584:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044549.781856:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044549.781861:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38423a3200/0x89871fc3aba19e87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c27 expref: 12 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781871:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38423a3200/0x89871fc3aba19e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c27 expref: 12 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781883:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38423a3200/0x89871fc3aba19e87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c27 expref: 12 pid: 22756 timeout: 842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781893:0:22750:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781901:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781916:0:22750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781923:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781929:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781936:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781948:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044549.781953:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781962:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781974:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044549.781985:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044549.782024:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:2410:x1870705565267584:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 176us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044549.782031:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1784044549.782200:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccdc2386-7f06-47a4-81d1-1145948bf326:3640:1870705581131136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044549.788029:0:25796:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.788049:0:25796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044549.788056:0:25796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19ef7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044549.794578:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581130880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044550.669563:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044550.733591:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581131648:0@lo:400:kworker.0 00000100:00100000:1.0:1784044550.733623:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581131264:0@lo:400:kworker.0 00000100:00100000:1.0:1784044550.733660:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044550.733660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044550.733712:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581131520:0@lo:400:kworker.0 00000100:00100000:2.0:1784044550.733764:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581131392:0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.737287:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581132160:0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.737510:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044550.737544:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705581132672:0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.737572:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044550.737624:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581131648 00000100:00100000:0.0:1784044550.737631:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581131648 00000100:00100000:0.0:1784044550.737680:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581132160 00000100:00100000:0.0:1784044550.737683:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581132160 00000100:00100000:0.0:1784044550.737708:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044550.737717:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581131648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.737772:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581131648:12345-0@lo:400:kworker.0 Request processed in 57us (4112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044550.737780:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044550.737796:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784044550.737802:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581132160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.737840:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581132160:12345-0@lo:400:kworker.0 Request processed in 38us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044550.737847:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784044550.737866:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581132672 00000100:00100000:0.0:1784044550.737869:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581132672 00000100:00100000:0.0:1784044550.737924:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784044550.737932:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705581132672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.737998:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705581132672:12345-0@lo:400:kworker.0 Request processed in 66us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044550.738005:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1784044550.738022:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044550.738037:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044550.744722:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581131776:0@lo:400:kworker.0 00000100:00100000:1.0:1784044550.744788:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044550.744820:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581132288:0@lo:400:kworker.0 00000100:00100000:1.0:1784044550.744838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044550.744852:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581132800:0@lo:400:kworker.0 00000100:00100000:1.0:1784044550.744869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044550.744977:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581131264 00000100:00100000:1.0:1784044550.744983:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581131264 00000100:00100000:1.0:1784044550.745023:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784044550.745030:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+20:3638:x1870705581131264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.746504:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581131648:0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.746528:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581131776 00000100:00100000:0.0:1784044550.746533:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581131776 00000100:00100000:0.0:1784044550.746572:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581132288 00000100:00100000:0.0:1784044550.746575:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581132288 00000100:00100000:0.0:1784044550.746587:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581132800 00000100:00100000:0.0:1784044550.746589:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581132800 00000100:00100000:0.0:1784044550.746613:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784044550.746619:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581131776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.746672:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581131776:12345-0@lo:400:kworker.0 Request processed in 51us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044550.746680:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784044550.746696:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784044550.746701:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581132288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.746729:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581132288:12345-0@lo:400:kworker.0 Request processed in 28us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044550.746734:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784044550.746744:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784044550.746749:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581132800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.746775:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581132800:12345-0@lo:400:kworker.0 Request processed in 26us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044550.746797:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1784044550.746818:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044550.746855:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581132160:0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.746867:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705581132672:0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.746891:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044550.746899:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581133056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044550.746928:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044550.746955:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581133056 00000100:00100000:0.0:1784044550.746959:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581133056 00000100:00100000:0.0:1784044550.747269:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784044550.747278:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581133056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044550.747301:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1784044550.747336:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581133056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044550.747344:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784044550.747377:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581133056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044550.747585:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581131776:0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.747604:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581132288:0@lo:400:kworker.0 00010000:00080000:0.0:1784044550.747618:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce7480 x1870705581132800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044550.747628:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581132800:0@lo:400:kworker.0 00000100:00100000:0.0:1784044550.747644:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044550.747653:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581132928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044550.747685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044550.747717:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581132928 00000100:00100000:0.0:1784044550.747721:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581132928 00000100:00100000:0.0:1784044550.747744:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784044550.747751:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581132928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044550.747761:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1784044550.747791:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581132928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044550.747798:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784044550.747891:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581132928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044550.748564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044550.748585:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581132032:0@lo:400:kworker.0 00000100:00100000:3.0:1784044550.748606:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044550.748626:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581131520 00000100:00100000:3.0:1784044550.748630:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581131520 00000100:00100000:3.0:1784044550.748660:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581132032 00000100:00100000:3.0:1784044550.748662:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581132032 00000100:00100000:3.0:1784044550.748676:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044550.748681:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581131520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044550.748717:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581131520:12345-0@lo:400:kworker.0 Request processed in 36us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044550.748723:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044550.748734:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784044550.748739:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581132032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044550.748757:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581132032:12345-0@lo:400:kworker.0 Request processed in 18us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044550.748762:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1784044550.748775:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044550.748789:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581132032:0@lo:400:kworker.0 00000100:00100000:3.0:1784044550.748796:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581132544:0@lo:400:kworker.0 00000100:00100000:3.0:1784044550.748815:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044550.748941:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581132544 00000100:00100000:3.0:1784044550.748944:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581132544 00000100:00100000:3.0:1784044550.748970:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784044550.748985:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581132544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044550.749011:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581132544:12345-0@lo:400:kworker.0 Request processed in 26us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044550.749016:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1784044550.749225:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784044550.749252:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce4e00 x1870705581132544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044550.749263:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581132544:0@lo:400:kworker.0 00000100:00100000:3.0:1784044550.749284:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581131520:0@lo:400:kworker.0 00000100:00100000:2.0:1784044550.749409:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044550.749437:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581131904:0@lo:400:kworker.0 00000100:00100000:2.0:1784044550.749457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044550.749487:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581131392 00000100:00100000:2.0:1784044550.749490:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581131392 00000100:00100000:2.0:1784044550.749514:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581131904 00000100:00100000:2.0:1784044550.749516:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581131904 00000100:00100000:2.0:1784044550.749527:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784044550.749531:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581131392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044550.749560:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581131392:12345-0@lo:400:kworker.0 Request processed in 28us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044550.749565:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784044550.749582:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784044550.749587:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581131904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044550.749609:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581131904:12345-0@lo:400:kworker.0 Request processed in 22us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044550.749614:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784044550.749635:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581131904:0@lo:400:kworker.0 00000100:00100000:2.0:1784044550.749641:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581132416:0@lo:400:kworker.0 00000100:00100000:2.0:1784044550.749659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044550.749675:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581132416 00000100:00100000:2.0:1784044550.749678:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581132416 00000100:00100000:2.0:1784044550.749701:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784044550.749706:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581132416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044550.749728:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581132416:12345-0@lo:400:kworker.0 Request processed in 22us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044550.749733:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1784044550.749744:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044550.749756:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581132416:0@lo:400:kworker.0 00000100:00100000:2.0:1784044550.749772:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581131392:0@lo:400:kworker.0 00000100:00100000:1.0:1784044550.757695:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+20:3638:x1870705581131264:12345-0@lo:400:kworker.0 Request processed in 12655us (24025us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044550.757710:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784044550.760361:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccdc2386-7f06-47a4-81d1-1145948bf326:3638:1870705581131264:0@lo:400:kworker.0 10000000:01000000:0.0:1784044551.309357:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784044551.309373:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b3952664800 from 13 10000000:01000000:0.0:1784044551.309379:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784044551.309427:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19efe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.309439:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19efe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.309450:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19efe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044551.309477:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044551.309544:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044551.309592:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044551.309807:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581133184 00000100:00100000:3.0:1784044551.309829:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581133184 00000100:00100000:3.0:1784044551.309882:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784044551.309891:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+20:22761:x1870705581133184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044551.309903:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044551.309916:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19f05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19efe expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.309937:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19f05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19efe expref: 21 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.309947:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba19f05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19efe expref: 21 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.309955:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7a00, rc 0) 00000100:00100000:3.0:1784044551.310004:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+21:22761:x1870705581133184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044551.310010:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784044551.310288:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044551.310303:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19efe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f05 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.310313:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19efe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19f05 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044551.310385:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044551.310414:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044551.310444:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3844627300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044551.310569:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581133312 00000100:00100000:2.0:1784044551.310574:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581133312 00000100:00100000:2.0:1784044551.310609:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784044551.310617:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:22761:x1870705581133312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044551.310733:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:22761:x1870705581133312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044551.310740:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784044551.311804:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044551.311857:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044551.311906:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044551.311941:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3844627300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044551.312006:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581133440 00000100:00100000:2.0:1784044551.312011:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581133440 00000100:00100000:2.0:1784044551.312039:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784044551.312046:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:22761:x1870705581133440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044551.312311:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:22761:x1870705581133440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044551.312319:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784044551.313332:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784044551.315670:0:25809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784044551.316471:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784044551.316497:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044551.316508:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19efe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f05 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.316519:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19efe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f05 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044551.316529:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784044551.316531:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b397590c800 from 13 10000000:01000000:1.0:1784044551.316534:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044551.316572:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38423a2a00/0x89871fc3aba19f0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.316581:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38423a2a00/0x89871fc3aba19f0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.316590:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38423a2a00/0x89871fc3aba19f0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044551.316615:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044551.316678:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044551.316724:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3844627300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044551.318470:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581133568 00000100:00100000:2.0:1784044551.318481:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581133568 00000100:00100000:2.0:1784044551.318547:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784044551.318556:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+21:22761:x1870705581133568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044551.318570:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044551.318584:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798800/0x89871fc3aba19f13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19f0c expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.318608:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798800/0x89871fc3aba19f13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19f0c expref: 22 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.318618:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798800/0x89871fc3aba19f13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19f0c expref: 22 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.318626:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798800, rc 0) 00000100:00100000:2.0:1784044551.318684:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+22:22761:x1870705581133568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044551.318691:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784044551.319538:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044551.319571:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38423a2a00/0x89871fc3aba19f0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f13 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.319580:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38423a2a00/0x89871fc3aba19f0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19f13 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044551.319651:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044551.319689:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044551.319772:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3844627300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044551.327506:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581133696 00000100:00100000:0.0:1784044551.327524:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581133696 00000100:00100000:0.0:1784044551.327604:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784044551.327615:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+22:22761:x1870705581133696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044551.328467:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+22:22761:x1870705581133696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 853us (8775us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044551.328477:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784044551.329635:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044551.329702:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044551.329773:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044551.329815:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3844627300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044551.329895:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581133824 00000100:00100000:0.0:1784044551.329901:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581133824 00000100:00100000:0.0:1784044551.329949:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784044551.329958:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+22:22761:x1870705581133824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044551.330627:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044551.331396:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+22:22761:x1870705581133824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1436us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044551.331406:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000040:00080000:1.0:1784044551.333935:0:25810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1784044551.336667:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1784044551.336703:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784044551.336715:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38423a2a00/0x89871fc3aba19f0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f13 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.336728:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38423a2a00/0x89871fc3aba19f0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f13 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044551.336739:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784044551.336742:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f3cb000 from 13 10000000:01000000:0.0:1784044551.336745:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784044551.336795:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19f1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.336803:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19f1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.336832:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19f1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044551.336858:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044551.336921:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044551.336970:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a8816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044551.337033:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581133952 00000100:00100000:1.0:1784044551.337041:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581133952 00000100:00100000:1.0:1784044551.337108:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784044551.337117:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+22:22761:x1870705581133952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044551.337129:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044551.337142:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38423a2400/0x89871fc3aba19f21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19f1a expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.337164:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38423a2400/0x89871fc3aba19f21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19f1a expref: 23 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.337196:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38423a2400/0x89871fc3aba19f21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19f1a expref: 23 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.337211:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38423a2400, rc 0) 00000100:00100000:1.0:1784044551.337278:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+23:22761:x1870705581133952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044551.337285:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784044551.337908:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581133952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044551.337924:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19f1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f21 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.337933:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19f1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19f21 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044551.337992:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581134080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044551.338019:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044551.338050:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a8816c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044551.338912:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581134080 00000100:00100000:1.0:1784044551.338918:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581134080 00000100:00100000:1.0:1784044551.338959:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784044551.338967:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+23:22761:x1870705581134080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044551.339113:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccdc2386-7f06-47a4-81d1-1145948bf326+23:22761:x1870705581134080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044551.339121:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784044551.339268:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581134080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044551.339304:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581134208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044551.339361:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044551.339405:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38433c2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044551.339750:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581134208 00000100:00100000:0.0:1784044551.339755:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581134208 00000100:00100000:0.0:1784044551.339798:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784044551.339806:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+23:22761:x1870705581134208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044551.339902:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+23:22761:x1870705581134208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044551.339909:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784044551.340020:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581134208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784044551.341447:0:25811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784044551.341630:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784044551.341651:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044551.341660:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19f1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f21 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.341672:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19f1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f21 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044551.341683:0:22761:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784044551.341686:0:22761:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b38431d5800 from 13 10000000:01000000:3.0:1784044551.341699:0:22761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044551.341727:0:22761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba19f28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.341734:0:22761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba19f28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.341742:0:22761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba19f28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044551.341760:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581134336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044551.341817:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044551.341844:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044551.342002:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581134336 00000100:00100000:0.0:1784044551.342008:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581134336 00000100:00100000:0.0:1784044551.342050:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784044551.342084:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+23:22761:x1870705581134336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044551.342096:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044551.342108:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fda00/0x89871fc3aba19f2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19f28 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.342131:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fda00/0x89871fc3aba19f2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19f28 expref: 24 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.342142:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fda00/0x89871fc3aba19f2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19f28 expref: 24 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.342151:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fda00, rc 0) 00000100:00100000:0.0:1784044551.342226:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:22761:x1870705581134336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044551.342244:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784044551.342398:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581134336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044551.342413:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba19f28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f2f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.342421:0:22761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba19f28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19f2f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044551.342476:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581134464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044551.342505:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044551.342527:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38446279c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044551.343044:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581134464 00000100:00100000:0.0:1784044551.343049:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581134464 00000100:00100000:0.0:1784044551.343100:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784044551.343107:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+24:22761:x1870705581134464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044551.343330:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+24:22761:x1870705581134464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044551.343337:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784044551.343651:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581134464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044551.343683:0:22761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581134592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044551.343727:0:22761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044551.343746:0:22761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044551.343833:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581134592 00000100:00100000:0.0:1784044551.343838:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581134592 00000100:00100000:0.0:1784044551.343857:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784044551.343863:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+24:22761:x1870705581134592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044551.343949:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccdc2386-7f06-47a4-81d1-1145948bf326+24:22761:x1870705581134592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044551.343962:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784044551.344098:0:22761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccdc2386-7f06-47a4-81d1-1145948bf326:22761:1870705581134592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784044551.346113:0:25812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784044551.356136:0:22761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784044551.356200:0:22761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044551.356213:0:22761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba19f28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f2f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.356225:0:22761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba19f28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19f2f expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044551.601612:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044551.601718:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565267712 00000100:00100000:0.0:1784044551.601727:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565267712 00000100:00100000:0.0:1784044551.601789:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:0.0:1784044551.601799:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+11:18107:x1870705565267712:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044551.601816:0:22759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044551.601835:0:22759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fd800/0x89871fc3aba19f36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6ccf expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.601863:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fd800/0x89871fc3aba19f36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ccf expref: 12 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.601874:0:22759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fd800/0x89871fc3aba19f36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ccf expref: 12 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044551.601883:0:22759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd800, rc 0) 00000100:00100000:0.0:1784044551.601947:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:18107:x1870705565267712:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 148us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044551.601954:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:0.0:1784044551.611678:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044551.612074:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565267840 00000100:00100000:3.0:1784044551.612085:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565267840 00000100:00100000:3.0:1784044551.612219:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:3.0:1784044551.612240:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:18107:x1870705565267840:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044551.612413:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:18107:x1870705565267840:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 175us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044551.612421:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:3.0:1784044551.633864:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044551.635684:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565267968 00000100:00100000:2.0:1784044551.635695:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565267968 00000100:00100000:2.0:1784044551.635746:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:2.0:1784044551.635756:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:18107:x1870705565267968:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044551.635900:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:18107:x1870705565267968:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 145us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044551.635908:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:1.0:1784044551.639870:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044551.640119:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565268096 00000100:00100000:3.0:1784044551.640131:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565268096 00000100:00100000:3.0:1784044551.640260:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:3.0:1784044551.640272:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+12:18107:x1870705565268096:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044551.640304:0:22758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044551.640329:0:22758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19f3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6cd6 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.640367:0:22758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cd6 expref: 13 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.640380:0:22758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b6a00/0x89871fc3aba19f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cd6 expref: 13 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.640391:0:22758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6a00, rc 0) 00000100:00100000:3.0:1784044551.640457:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18107:x1870705565268096:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 188us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044551.640465:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:2.0:1784044551.643007:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044551.643336:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565268224 00000100:00100000:1.0:1784044551.643349:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565268224 00000100:00100000:1.0:1784044551.643424:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:1.0:1784044551.643436:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18107:x1870705565268224:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044551.643659:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18107:x1870705565268224:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 226us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044551.643668:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:1.0:1784044551.647048:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044551.647313:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565268352 00000100:00100000:2.0:1784044551.647325:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565268352 00000100:00100000:2.0:1784044551.647400:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:2.0:1784044551.647412:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18107:x1870705565268352:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044551.647619:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:740c6da5-f7fc-45c9-b5c9-a88235e5f76d+13:18107:x1870705565268352:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 207us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044551.647629:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 167 00010000:00010000:1.0:1784044551.695348:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044551.732645:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044551.733095:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565268480 00000100:00100000:3.0:1784044551.733108:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565268480 00000100:00100000:3.0:1784044551.733268:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1784044551.733309:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+6:18726:x1870705565268480:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044551.733338:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044551.734931:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19f44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6cdd expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735018:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735034:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735047:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735062:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2000/0x89871fc3aba19f52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735069:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2000/0x89871fc3aba19f52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735076:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2000/0x89871fc3aba19f52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735166:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2e00/0x89871fc3aba19f59 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735192:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2e00/0x89871fc3aba19f59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735213:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2e00/0x89871fc3aba19f59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044551.735257:0:22764:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784044551.735261:0:22764:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044551.735296:0:22764:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2e00/0x89871fc3aba19f59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735307:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735314:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735321:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735327:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a2800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044551.735331:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735337:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735348:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758beb00) 00010000:00010000:1.0:1784044551.735351:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044551.735354:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735361:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735386:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2000/0x89871fc3aba19f52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735391:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2000/0x89871fc3aba19f52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735397:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2000/0x89871fc3aba19f52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735403:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a2000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044551.735406:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2000/0x89871fc3aba19f52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735411:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2000/0x89871fc3aba19f52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735418:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b3842777900) 00010000:00010000:1.0:1784044551.735420:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044551.735423:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2000/0x89871fc3aba19f52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735428:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2000/0x89871fc3aba19f52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735459:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19f44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cdd expref: 8 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735472:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2e00/0x89871fc3aba19f59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cdd expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.735489:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b3842777700) 00010000:00010000:1.0:1784044551.735491:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044551.735493:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38423a2e00, rc 0) 00000100:00100000:1.0:1784044551.735602:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+7:18726:x1870705565268480:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 2295us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044551.735610:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00080000:2.0:1784044551.737430:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044551.759366:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581134720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044551.759444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044551.759525:0:24279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581134720 00000100:00100000:1.0:1784044551.759533:0:24279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581134720 00000100:00100000:1.0:1784044551.759598:0:24279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784044551.759608:0:24279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581134720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044551.759637:0:24279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044551.762091:0:24279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581134720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2477us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044551.762104:0:24279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784044551.762210:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581134720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044551.765596:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044551.767518:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565268608 00000100:00100000:2.0:1784044551.767529:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565268608 00000100:00100000:2.0:1784044551.767593:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:2.0:1784044551.767604:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9e67ce78-1674-4eab-b693-10f988e5915a+7:18726:x1870705565268608:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1784044551.767685:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9e67ce78-1674-4eab-b693-10f988e5915a+7:18726:x1870705565268608:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 Request processed in 83us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044551.767706:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1784044551.788277:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044551.788419:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565268864 00000100:00100000:2.0:1784044551.788429:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565268864 00000100:00100000:2.0:1784044551.788487:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1784044551.788497:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+7:18726:x1870705565268864:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044551.788520:0:24585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044551.788542:0:24585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba19f60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6ce4 expref: -99 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.788622:0:24585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba19f67 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.788637:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba19f67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.788650:0:24585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba19f67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.788664:0:24585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba19f6e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.788671:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba19f6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.788678:0:24585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba19f6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789038:0:24585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba19f75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789064:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba19f75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789072:0:24585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba19f75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044551.789084:0:24585:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1784044551.789266:0:24585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba19f67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789275:0:24585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba19f67 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789282:0:24585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba19f67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789289:0:24585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044551.789293:0:24585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba19f67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789302:0:24585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba19f67 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789313:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b3842777700) 00010000:00010000:2.0:1784044551.789317:0:24585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044551.789321:0:24585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba19f67 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789328:0:24585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba19f67 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789341:0:24585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba19f6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789353:0:24585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba19f6e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789359:0:24585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba19f6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789364:0:24585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044551.789367:0:24585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba19f6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789373:0:24585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba19f6e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789380:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b397b61b300) 00010000:00010000:2.0:1784044551.789382:0:24585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044551.789385:0:24585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba19f6e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.789392:0:24585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba19f6e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.792389:0:24585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba19f60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ce4 expref: 10 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.792418:0:24585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba19f75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ce4 expref: 9 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.792428:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b397b61b600) 00010000:00010000:2.0:1784044551.792431:0:24585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044551.792445:0:24585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798600, rc 0) 00000100:00100000:2.0:1784044551.792523:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+9:18726:x1870705565268864:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 4026us (4256us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1784044551.792532:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1784044551.801474:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044551.801570:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565268992 00000100:00100000:1.0:1784044551.801580:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565268992 00000100:00100000:1.0:1784044551.801636:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:1.0:1784044551.801646:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+9:18726:x1870705565268992:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784044551.801765:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+9:18726:x1870705565268992:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 120us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044551.801772:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:1.0:1784044551.805728:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044551.805813:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565269120 00000100:00100000:0.0:1784044551.805822:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565269120 00000100:00100000:0.0:1784044551.805885:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:0.0:1784044551.805894:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+5:18726:x1870705565269120:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1784044551.805979:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1784044551.810219:0:22766:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4289us 00000100:00100000:2.0:1784044551.822341:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+5:18726:x1870705565269120:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 16437us (16611us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044551.822355:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1784044551.905576:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044551.905911:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565269248 00000100:00100000:1.0:1784044551.905922:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565269248 00000100:00100000:1.0:1784044551.905981:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:1.0:1784044551.906010:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+9:18731:x1870705565269248:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044551.906030:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044551.906050:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6ceb expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906123:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19f8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906137:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19f8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906150:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19f8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906165:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906447:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906459:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906496:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19f8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906502:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19f8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906510:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19f8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906526:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044551.906530:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19f8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906537:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19f8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906549:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758beb00) 00010000:00010000:1.0:1784044551.906552:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044551.906556:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19f8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906563:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19f8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906576:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906582:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906587:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906592:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044551.906595:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906600:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906615:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b3842777900) 00010000:00010000:1.0:1784044551.906618:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044551.906620:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906626:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906655:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ceb expref: 10 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906665:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758beb00) 00010000:00010000:1.0:1784044551.906667:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044551.906671:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba19f83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ceb expref: 10 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.906679:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38423a2800, rc 0) 00000100:00100000:1.0:1784044551.906782:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+9:18731:x1870705565269248:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 773us (1215us total) trans 0 rc 301/301 00000100:00100000:1.0:1784044551.906790:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:2.0:1784044551.915604:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044551.915702:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565269376 00000100:00100000:3.0:1784044551.915710:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565269376 00000100:00100000:3.0:1784044551.915847:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:3.0:1784044551.915858:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9e67ce78-1674-4eab-b693-10f988e5915a+9:18731:x1870705565269376:12345-192.168.202.40@tcp:700:lfs.0 00000100:00100000:3.0:1784044551.915939:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9e67ce78-1674-4eab-b693-10f988e5915a+9:18731:x1870705565269376:12345-192.168.202.40@tcp:700:lfs.0 Request processed in 84us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044551.915947:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1784044551.927152:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044551.928099:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565269632 00000100:00100000:3.0:1784044551.928111:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565269632 00000100:00100000:3.0:1784044551.928194:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:3.0:1784044551.928214:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+9:18731:x1870705565269632:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:3.0:1784044551.928280:0:24585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044551.928306:0:24585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19eb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6c58 expref: 9 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.928326:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758beb00) 00010000:00010000:3.0:1784044551.928332:0:24585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044551.928501:0:24585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.928516:0:24585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cc8 expref: 5 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.928542:0:24585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.928575:0:24585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cc8 expref: 5 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044551.928588:0:24585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cc8 expref: 5 pid: 22765 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044551.928603:0:24585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24585:1870705581134848:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044551.928699:0:24585:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38433c2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044551.933880:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044551.934087:0:24585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24585:1870705581134848:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044551.934113:0:24585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044551.934249:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565269760 00000100:00100000:2.0:1784044551.934257:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565269760 00010000:00010000:2.0:1784044551.934313:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cc8 expref: 6 pid: 22765 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044551.934351:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1784044551.934360:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e036a9-673f-4154-85f2-09160098f67f+6:2410:x1870705565269760:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044551.934478:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044551.934486:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cc8 expref: 6 pid: 22765 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.934499:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cc8 expref: 6 pid: 22765 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.934520:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19ef0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cc8 expref: 6 pid: 22765 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.934554:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758beb00) 00010000:00010000:2.0:1784044551.934560:0:22750:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.934569:0:22750:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.934577:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044551.934603:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044551.934652:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73e036a9-673f-4154-85f2-09160098f67f+5:2410:x1870705565269760:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 292us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044551.934659:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00080000:3.0:1784044551.934842:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784044551.934969:0:24585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.934977:0:24585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.935099:0:24585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.935116:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.935125:0:24585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.940985:0:24585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.941014:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.941027:0:24585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044551.941047:0:24585:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e6c7e1d reply state 000000003a546f0c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.941061:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.941069:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b3842777600) 00010000:00010000:1.0:1784044551.941072:0:24585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044551.941077:0:24585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784044551.941905:0:24585:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784044551.941923:0:24585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.941932:0:24585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.941940:0:24585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.942763:0:24585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044551.942773:0:24585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.942784:0:24585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.942805:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758beb00) 00010000:00010000:1.0:1784044551.942809:0:24585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044551.942814:0:24585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.942821:0:24585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba19f98 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044551.942853:0:24585:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e6c7e1d reply state 000000003a546f0c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.942866:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044551.942873:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b3842777900) 00010000:00010000:1.0:1784044551.942875:0:24585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044551.942878:0:24585:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784044551.943531:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+10:18731:x1870705565269632:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 15319us (16379us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1784044551.943545:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1784044552.050207:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.050346:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565269888 00000100:00100000:0.0:1784044552.050365:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565269888 00000100:00100000:0.0:1784044552.050459:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1784044552.050471:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+10:18740:x1870705565269888:12345-192.168.202.40@tcp:101:lctl.0 00010000:00010000:0.0:1784044552.050504:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.050534:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19fad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6cf2 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.050624:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba19fb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.050641:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba19fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.050654:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba19fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044552.050715:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044552.050719:0:22765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044552.050763:0:22765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba19fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.050792:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19fad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cf2 expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.050840:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba19fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cf2 expref: 11 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.050849:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758bef00) 00010000:00010000:0.0:1784044552.050852:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044552.050856:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd400, rc 0) 00000100:00100000:0.0:1784044552.050941:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+11:18740:x1870705565269888:12345-192.168.202.40@tcp:101:lctl.0 Request processed in 471us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044552.050948:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1784044552.095807:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044552.095946:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565270016 00000100:00100000:2.0:1784044552.095970:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565270016 00000100:00100000:2.0:1784044552.096064:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:2.0:1784044552.096077:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73e036a9-673f-4154-85f2-09160098f67f+5:18741:x1870705565270016:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044552.096107:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044552.096146:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba19fbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6cf9 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.096520:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba19fc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.096539:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba19fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.096554:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba19fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044552.096630:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784044552.096633:0:22766:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044552.096661:0:22766:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba19fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.096691:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba19fbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cf9 expref: 7 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.096714:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba19fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6cf9 expref: 6 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.096725:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758bef00) 00010000:00010000:2.0:1784044552.096729:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044552.096732:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799c00, rc 0) 00000100:00100000:2.0:1784044552.096814:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73e036a9-673f-4154-85f2-09160098f67f+6:18741:x1870705565270016:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 740us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044552.096823:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:2.0:1784044552.099597:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.106040:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565270144 00000100:00100000:0.0:1784044552.106062:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565270144 00000100:00100000:0.0:1784044552.106201:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:0.0:1784044552.106215:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73e036a9-673f-4154-85f2-09160098f67f+6:18741:x1870705565270144:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044552.106254:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.106299:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19fc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d00 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106389:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba19fd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106407:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba19fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106421:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba19fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106458:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19fd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106467:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106474:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106581:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19fde lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106590:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19fde lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106597:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19fde lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044552.106649:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044552.106654:0:22765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044552.106682:0:22765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19fde lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106698:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba19fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106705:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba19fd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106713:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba19fd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106730:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fce00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044552.106735:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba19fd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106744:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba19fd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106760:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758bef00) 00010000:00010000:0.0:1784044552.106763:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044552.106769:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba19fd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106775:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba19fd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106790:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106797:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19fd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106803:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106808:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044552.106811:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106818:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19fd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106838:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b3842777900) 00010000:00010000:0.0:1784044552.106841:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044552.106844:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19fd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106850:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba19fd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106884:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19fc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d00 expref: 8 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106900:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19fde lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d00 expref: 7 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.106908:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b3842777600) 00010000:00010000:0.0:1784044552.106910:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044552.106913:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc800, rc 0) 00000100:00100000:0.0:1784044552.107009:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73e036a9-673f-4154-85f2-09160098f67f+7:18741:x1870705565270144:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 797us (7425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044552.107018:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1784044552.109849:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044552.110458:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565270272 00000100:00100000:2.0:1784044552.110476:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565270272 00000100:00100000:2.0:1784044552.110583:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:2.0:1784044552.110598:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:73e036a9-673f-4154-85f2-09160098f67f+5:18741:x1870705565270272:12345-192.168.202.40@tcp:900:lfs.0 00000100:00080000:3.0:1784044552.110603:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044552.110715:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:73e036a9-673f-4154-85f2-09160098f67f+5:18741:x1870705565270272:12345-192.168.202.40@tcp:900:lfs.0 Request processed in 119us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044552.110725:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:2.0:1784044552.127046:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.127266:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565270528 00000100:00100000:0.0:1784044552.127281:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565270528 00000100:00100000:0.0:1784044552.127360:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:0.0:1784044552.127372:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73e036a9-673f-4154-85f2-09160098f67f+7:18741:x1870705565270528:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044552.127400:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.127426:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19fe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d07 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044552.127581:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784044552.127726:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19fe5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d07 expref: 9 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.127743:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758bef00) 00010000:00010000:0.0:1784044552.127747:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044552.127753:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19fe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d07 expref: 9 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.127771:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc000, rc 0) 00000100:00100000:0.0:1784044552.127862:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73e036a9-673f-4154-85f2-09160098f67f+8:18741:x1870705565270528:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 492us (830us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1784044552.127870:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:2.0:1784044552.134157:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.134294:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565270784 00000100:00100000:0.0:1784044552.134307:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565270784 00000100:00100000:0.0:1784044552.134386:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:0.0:1784044552.134399:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73e036a9-673f-4154-85f2-09160098f67f+8:18741:x1870705565270784:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:0.0:1784044552.134474:0:22765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044552.134510:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19fde lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d00 expref: 8 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.134533:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b3842777600) 00010000:00010000:0.0:1784044552.134539:0:22765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044552.134569:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.134609:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.134620:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044552.134876:0:22765:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff04778a reply state 00000000edaa31cc transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.134891:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.134897:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b3842777600) 00010000:00010000:0.0:1784044552.134900:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1784044552.134903:0:22765:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784044552.134912:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784044552.135029:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73e036a9-673f-4154-85f2-09160098f67f+9:18741:x1870705565270784:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 631us (885us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1784044552.135037:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1784044552.137380:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044552.137495:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565271040 00000100:00100000:2.0:1784044552.137505:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565271040 00000100:00100000:2.0:1784044552.137583:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:2.0:1784044552.137594:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73e036a9-673f-4154-85f2-09160098f67f+9:18741:x1870705565271040:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044552.137888:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73e036a9-673f-4154-85f2-09160098f67f+10:18741:x1870705565271040:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 293us (521us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1784044552.137897:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:2.0:1784044552.149596:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.149884:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565271296 00000100:00100000:0.0:1784044552.149898:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565271296 00000100:00100000:0.0:1784044552.149981:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:0.0:1784044552.149992:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73e036a9-673f-4154-85f2-09160098f67f+10:18741:x1870705565271296:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044552.150021:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.150045:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19ffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d0e expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150143:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a001 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150216:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150242:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150259:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a008 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150266:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150272:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044552.150411:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784044552.150512:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150520:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a001 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150528:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a001 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150536:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044552.150541:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a001 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150549:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a001 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150576:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758bef00) 00010000:00010000:0.0:1784044552.150578:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044552.150584:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150590:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150605:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150611:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a008 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150616:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150621:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fce00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044552.150624:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150629:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a008 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150636:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b3842777900) 00010000:00010000:0.0:1784044552.150638:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044552.150641:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a008 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150646:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a008 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150698:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19ffa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d0e expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150710:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758bef00) 00010000:00010000:0.0:1784044552.150714:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044552.150717:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba19ffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d0e expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.150726:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc800, rc 0) 00000100:00100000:0.0:1784044552.151020:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73e036a9-673f-4154-85f2-09160098f67f+11:18741:x1870705565271296:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1028us (1435us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1784044552.151030:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:3.0:1784044552.156683:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.156788:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565271424 00000100:00100000:0.0:1784044552.156802:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565271424 00000100:00100000:0.0:1784044552.156885:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:0.0:1784044552.156898:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73e036a9-673f-4154-85f2-09160098f67f+11:18741:x1870705565271424:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044552.156931:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.156957:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a016 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d15 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.157095:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.157114:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.157127:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044552.157215:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044552.157230:0:22765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044552.157255:0:22765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.157287:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a016 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d15 expref: 13 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.157316:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d15 expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.157326:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b3842777600) 00010000:00010000:0.0:1784044552.157329:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044552.157333:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fce00, rc 0) 00000100:00100000:0.0:1784044552.157415:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73e036a9-673f-4154-85f2-09160098f67f+12:18741:x1870705565271424:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 519us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044552.157424:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:3.0:1784044552.160247:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044552.160449:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565271552 00000100:00100000:2.0:1784044552.160462:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565271552 00000100:00100000:2.0:1784044552.160536:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:2.0:1784044552.160548:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73e036a9-673f-4154-85f2-09160098f67f+12:18741:x1870705565271552:12345-192.168.202.40@tcp:37:lfs.0 00000100:00100000:1.0:1784044552.165883:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73e036a9-673f-4154-85f2-09160098f67f+12:18741:x1870705565271552:12345-192.168.202.40@tcp:37:lfs.0 Request processed in 5320us (5645us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044552.165917:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:1.0:1784044552.169491:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044552.169575:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565271808 00000100:00100000:2.0:1784044552.169587:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565271808 00000100:00100000:2.0:1784044552.169656:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:2.0:1784044552.169667:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397c9c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:73e036a9-673f-4154-85f2-09160098f67f+12:18741:x1870705565271808:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044552.169939:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397c9c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:73e036a9-673f-4154-85f2-09160098f67f+13:18741:x1870705565271808:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 272us (460us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1784044552.169948:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000040:00080000:2.0:1784044552.206041:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784044552.223673:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.223771:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565271936 00000100:00100000:0.0:1784044552.223784:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565271936 00000100:00100000:0.0:1784044552.223862:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:0.0:1784044552.223873:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+11:18747:x1870705565271936:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1784044552.223901:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.223926:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a024 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d1c expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224002:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a02b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224040:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a02b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224053:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a02b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224064:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a032 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224072:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224078:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224231:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba1a039 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224241:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba1a039 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224248:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba1a039 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044552.224451:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044552.224456:0:22766:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044552.224501:0:22766:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba1a039 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224575:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a02b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224593:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a02b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224601:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a02b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224615:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044552.224620:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a02b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224628:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a02b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224643:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758bef00) 00010000:00010000:0.0:1784044552.224646:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044552.224651:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a02b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224658:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a02b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224671:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224677:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a032 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224683:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224689:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fcc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044552.224697:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224703:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a032 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224710:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b3842777900) 00010000:00010000:0.0:1784044552.224713:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044552.224715:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a032 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224721:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a032 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224750:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a024 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d1c expref: 13 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224763:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba1a039 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d1c expref: 12 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.224770:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b3842777600) 00010000:00010000:0.0:1784044552.224772:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784044552.224775:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fdc00, rc 0) 00000100:00100000:0.0:1784044552.224859:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+12:18747:x1870705565271936:12345-192.168.202.40@tcp:101:bash.0 Request processed in 988us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044552.224867:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:0.0:1784044552.230207:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044552.230266:0:22776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565272064 00000100:00100000:2.0:1784044552.230283:0:22776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565272064 00000100:00100000:2.0:1784044552.230376:0:22776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1784044552.230389:0:22776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9e67ce78-1674-4eab-b693-10f988e5915a+5:18747:x1870705565272064:12345-192.168.202.40@tcp:900:bash.0 00000100:00100000:2.0:1784044552.230507:0:22776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9e67ce78-1674-4eab-b693-10f988e5915a+5:18747:x1870705565272064:12345-192.168.202.40@tcp:900:bash.0 Request processed in 121us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044552.230536:0:22776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1784044552.234031:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044552.234124:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565272320 00000100:00100000:1.0:1784044552.234144:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565272320 00000100:00100000:1.0:1784044552.234264:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:1.0:1784044552.234277:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+12:18747:x1870705565272320:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1784044552.234314:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044552.234343:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3c00/0x89871fc3aba1a040 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d23 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.234482:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.234502:0:22764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d15 expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.234512:0:22764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.234558:0:22764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d15 expref: 12 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.234574:0:22764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d15 expref: 12 pid: 22765 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044552.234591:0:22764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22764:1870705581134976:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044552.234691:0:22764:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39527706c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044552.236580:0:22764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22764:1870705581134976:192.168.202.40@tcp:104: 00010000:00010000:1.0:1784044552.236618:0:22764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044552.238092:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044552.238247:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565272448 00000100:00100000:1.0:1784044552.238257:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565272448 00010000:00010000:1.0:1784044552.238312:0:25108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d15 expref: 13 pid: 22765 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044552.238349:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1784044552.238359:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:73e036a9-673f-4154-85f2-09160098f67f+13:2409:x1870705565272448:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044552.238379:0:25108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044552.238386:0:25108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d15 expref: 13 pid: 22765 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.238401:0:25108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d15 expref: 13 pid: 22765 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.238427:0:25108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a01d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d15 expref: 13 pid: 22765 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.238445:0:25108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b3842777600) 00010000:00010000:1.0:1784044552.238451:0:25108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.238463:0:25108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.238471:0:25108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.238524:0:25108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044552.238576:0:22764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.238587:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044552.238597:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:73e036a9-673f-4154-85f2-09160098f67f+12:2409:x1870705565272448:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 237us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044552.238606:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00010000:00010000:2.0:1784044552.238773:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.238796:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.238810:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239521:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a055 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239532:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a055 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239540:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a055 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044552.239551:0:22764:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784044552.239576:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239583:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239605:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239611:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a2600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044552.239616:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239624:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239637:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b3842777600) 00010000:00010000:2.0:1784044552.239640:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044552.239643:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239649:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2600/0x89871fc3aba1a047 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044552.239663:0:22764:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075d13744 reply state 000000004d73a66d transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239674:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239683:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9b397b61b300) 00010000:00010000:2.0:1784044552.239685:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784044552.239688:0:22764:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784044552.239722:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3c00/0x89871fc3aba1a040 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d23 expref: 15 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239737:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a055 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d23 expref: 14 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.239750:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:2.0:1784044552.239752:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1784044552.239762:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798200, rc 0) 00000100:00100000:2.0:1784044552.239833:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+15:18747:x1870705565272320:12345-192.168.202.40@tcp:101:bash.0 Request processed in 5558us (5814us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1784044552.239841:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:3.0:1784044552.250060:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.250241:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565272576 00000100:00100000:0.0:1784044552.250255:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565272576 00000100:00100000:0.0:1784044552.250323:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:0.0:1784044552.250359:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+15:18747:x1870705565272576:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1784044552.250391:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.250416:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a063 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d2a expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.250478:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.250492:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.250504:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044552.250549:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784044552.250552:0:22766:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044552.250570:0:22766:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.250581:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.250604:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a063 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d2a expref: 17 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.250621:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d2a expref: 16 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.250630:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:0.0:1784044552.250633:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044552.250643:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fcc00, rc 0) 00000100:00100000:0.0:1784044552.250709:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+16:18747:x1870705565272576:12345-192.168.202.40@tcp:101:bash.0 Request processed in 352us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044552.250716:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:3.0:1784044552.253414:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044552.253655:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565272832 00000100:00100000:2.0:1784044552.253667:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565272832 00000100:00100000:2.0:1784044552.253746:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:2.0:1784044552.253756:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e67ce78-1674-4eab-b693-10f988e5915a+16:18747:x1870705565272832:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:2.0:1784044552.254112:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e67ce78-1674-4eab-b693-10f988e5915a+17:18747:x1870705565272832:12345-192.168.202.40@tcp:35:bash.0 Request processed in 354us (707us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1784044552.254121:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1784044552.333622:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.333919:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565273088 00000100:00100000:0.0:1784044552.333932:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565273088 00000100:00100000:0.0:1784044552.334026:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1784044552.334036:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+17:18757:x1870705565273088:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044552.334069:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.334094:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d31 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044552.334270:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784044552.334415:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a071 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d31 expref: 19 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.334432:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758bef00) 00010000:00010000:0.0:1784044552.334436:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044552.334441:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d31 expref: 19 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.334457:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fde00, rc 0) 00000100:00100000:0.0:1784044552.334538:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+18:18757:x1870705565273088:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 503us (930us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1784044552.334547:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:3.0:1784044552.338714:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044552.338905:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565273344 00000100:00100000:1.0:1784044552.338917:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565273344 00000100:00100000:1.0:1784044552.338994:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1784044552.339005:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+18:18757:x1870705565273344:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1784044552.339352:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+19:18757:x1870705565273344:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 348us (650us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1784044552.339361:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1784044552.373558:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.373651:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565273600 00000100:00100000:0.0:1784044552.373663:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565273600 00000100:00100000:0.0:1784044552.373744:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:0.0:1784044552.373774:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+19:18760:x1870705565273600:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044552.373804:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.373830:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a07f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d38 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.373965:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a086 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.373982:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a086 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.373996:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a086 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044552.374010:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784044552.374143:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a07f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d38 expref: 22 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.374164:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a086 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d38 expref: 21 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.374235:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:0.0:1784044552.374239:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044552.374242:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc600, rc 0) 00000100:00100000:0.0:1784044552.374320:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+21:18760:x1870705565273600:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 547us (775us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1784044552.374327:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:3.0:1784044552.378570:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044552.378612:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044552.378727:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565273856 00000100:00100000:2.0:1784044552.378740:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565273856 00000100:00100000:2.0:1784044552.378829:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1784044552.378840:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+21:2410:x1870705565273856:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044552.378862:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044552.378892:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a086 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d38 expref: 21 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.378914:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:2.0:1784044552.378920:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044552.379265:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+20:2410:x1870705565273856:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 423us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044552.379293:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1784044552.379932:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565273728 00000100:00100000:0.0:1784044552.379941:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565273728 00000100:00100000:0.0:1784044552.380010:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:0.0:1784044552.380018:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+20:18760:x1870705565273728:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:0.0:1784044552.380098:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a094 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.380115:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a094 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.380128:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a094 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.380170:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a094 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.380201:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a094 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.380209:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a094 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.380215:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fca00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044552.380231:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a094 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.380241:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a094 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.380251:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:0.0:1784044552.380255:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044552.380260:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a094 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.380293:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a094 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044552.380365:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+20:18760:x1870705565273728:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 347us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044552.380374:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:3.0:1784044552.384630:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044552.384840:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565274112 00000100:00100000:1.0:1784044552.384852:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565274112 00000100:00100000:1.0:1784044552.384917:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:1.0:1784044552.384927:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+20:18760:x1870705565274112:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1784044552.385255:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+21:18760:x1870705565274112:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 328us (638us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1784044552.385264:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1784044552.422934:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044552.422986:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044552.423017:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044552.423050:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044552.423090:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565274240 00000100:00100000:3.0:1784044552.423101:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565274240 00000100:00100000:3.0:1784044552.423162:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565274496 00000100:00100000:3.0:1784044552.423165:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565274496 00000100:00100000:3.0:1784044552.423216:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565274368 00000100:00100000:3.0:1784044552.423250:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565274368 00000100:00100000:3.0:1784044552.423268:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565274624 00000100:00100000:3.0:1784044552.423270:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565274624 00000100:00100000:3.0:1784044552.423289:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1784044552.423300:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+5:2408:x1870705565274240:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044552.423382:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+5:2408:x1870705565274240:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 83us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044552.423390:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1784044552.423409:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1784044552.423415:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73e036a9-673f-4154-85f2-09160098f67f+5:2408:x1870705565274496:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044552.423435:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73e036a9-673f-4154-85f2-09160098f67f+5:2408:x1870705565274496:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044552.423441:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1784044552.423468:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1784044552.423474:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+5:2408:x1870705565274368:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044552.423496:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+5:2408:x1870705565274368:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044552.423501:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1784044552.423511:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1784044552.423516:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73e036a9-673f-4154-85f2-09160098f67f+5:2408:x1870705565274624:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044552.423534:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73e036a9-673f-4154-85f2-09160098f67f+5:2408:x1870705565274624:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 18us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044552.423540:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00080000:3.0:1784044552.423556:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044552.423560:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1784044552.594620:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784044552.612909:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.613041:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565274880 00000100:00100000:0.0:1784044552.613055:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565274880 00000100:00100000:0.0:1784044552.613134:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:0.0:1784044552.613146:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+21:18791:x1870705565274880:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1784044552.613231:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.613260:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a09b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d3f expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.613414:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0a2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.613433:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.613446:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044552.613460:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784044552.613607:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a09b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d3f expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.613629:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d3f expref: 23 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.613654:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:0.0:1784044552.613657:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044552.613662:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fde00, rc 0) 00000100:00100000:0.0:1784044552.613741:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+23:18791:x1870705565274880:12345-192.168.202.40@tcp:101:cat.0 Request processed in 597us (846us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1784044552.613748:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:3.0:1784044552.625432:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044552.625539:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565275136 00000100:00100000:1.0:1784044552.625551:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565275136 00000100:00100000:1.0:1784044552.625630:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1784044552.625642:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+23:18791:x1870705565275136:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:1.0:1784044552.626032:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+24:18791:x1870705565275136:12345-192.168.202.40@tcp:35:cat.0 Request processed in 390us (613us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1784044552.626061:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:3.0:1784044552.628362:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044552.628624:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565275264 00000100:00100000:1.0:1784044552.628635:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565275264 00000100:00100000:1.0:1784044552.628732:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1784044552.628742:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e67ce78-1674-4eab-b693-10f988e5915a+24:2408:x1870705565275264:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044552.628767:0:25108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044552.628799:0:25108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0a2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d3f expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.628822:0:25108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:1.0:1784044552.628828:0:25108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044552.628897:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e67ce78-1674-4eab-b693-10f988e5915a+23:2408:x1870705565275264:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 155us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044552.628905:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:3.0:1784044552.703651:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.703837:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565275520 00000100:00100000:0.0:1784044552.703849:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565275520 00000100:00100000:0.0:1784044552.703926:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:0.0:1784044552.703938:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+23:18797:x1870705565275520:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:0.0:1784044552.703968:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.703993:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a0b0 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d46 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.704165:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0b7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.704213:0:22765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a055 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d23 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.704241:0:22765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d2a expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.704251:0:22765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0b7 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.704296:0:22765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d2a expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.704318:0:22765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d2a expref: 24 pid: 22766 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044552.704334:0:22765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22765:1870705581135104:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044552.704444:0:22765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a055 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d23 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.704454:0:22765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a055 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d23 expref: 24 pid: 22764 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044552.704463:0:22765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22765:1870705581135232:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044552.704485:0:22765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341b600 going to sleep for 11 seconds 00000100:00100000:3.0:1784044552.712368:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044552.712413:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044552.712569:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565275648 00000100:00100000:2.0:1784044552.712580:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565275648 00010000:00010000:2.0:1784044552.712633:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d2a expref: 25 pid: 22766 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044552.712679:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565275776 00000100:00100000:2.0:1784044552.712682:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565275776 00010000:00010000:2.0:1784044552.712694:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a055 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d23 expref: 26 pid: 22764 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044552.712720:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1784044552.712729:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+26:2407:x1870705565275648:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044552.712748:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044552.712756:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d2a expref: 26 pid: 22766 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.712770:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d2a expref: 26 pid: 22766 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.712797:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:2.0:1784044552.712802:0:22750:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0b7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.712812:0:22750:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0b7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.712839:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044552.712900:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+26:2407:x1870705565275648:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 171us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044552.712908:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1784044552.712926:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:2.0:1784044552.712932:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+25:2407:x1870705565275776:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044552.712940:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044552.712945:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a055 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d23 expref: 25 pid: 22764 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.712955:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a055 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d23 expref: 25 pid: 22764 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.712967:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:2.0:1784044552.712971:0:22750:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0b7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.712980:0:22750:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0b7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.712988:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0b7 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.713007:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044552.713022:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+25:2407:x1870705565275776:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 90us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044552.713028:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00010000:00010000:0.0:1784044552.715545:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a06a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d2a expref: 24 pid: 22766 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044552.715574:0:22765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22765:1870705581135104:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044552.715588:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a055 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d23 expref: 23 pid: 22764 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044552.715602:0:22765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22765:1870705581135232:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044552.715632:0:22765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0b7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.715643:0:22765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0b7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.715668:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0b7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044552.715694:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784044552.715900:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a0b0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d46 expref: 24 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.715917:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba1a0b7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d46 expref: 23 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.715929:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:0.0:1784044552.715931:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784044552.715935:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fde00, rc 0) 00000100:00100000:0.0:1784044552.716021:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+23:18797:x1870705565275520:12345-192.168.202.40@tcp:101:dd.0 Request processed in 12085us (12382us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1784044552.716032:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00010000:00010000:1.0:1784044552.719147:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044552.720131:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.722382:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565275904 00000100:00100000:0.0:1784044552.722401:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565275904 00000100:00100000:0.0:1784044552.722564:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:0.0:1784044552.722578:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+23:18797:x1870705565275904:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:0.0:1784044552.722614:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.722643:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a0c5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d4d expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.722696:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a0cc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.722735:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a0cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.722749:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a0cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.722884:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a0c5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d4d expref: 25 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.722906:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a0cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d4d expref: 24 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.722914:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:0.0:1784044552.722917:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044552.722921:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fce00, rc 0) 00000100:00100000:0.0:1784044552.723016:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+24:18797:x1870705565275904:12345-192.168.202.40@tcp:101:dd.0 Request processed in 441us (2897us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044552.723025:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:3.0:1784044552.726590:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044552.726699:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565276160 00000100:00100000:2.0:1784044552.726712:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565276160 00000100:00100000:2.0:1784044552.726787:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:2.0:1784044552.726798:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+24:18797:x1870705565276160:12345-192.168.202.40@tcp:36:dd.0 00010000:00010000:2.0:1784044552.727105:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.727127:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.727142:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044552.727228:0:22764:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1784044552.727264:0:22764:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026c68162 reply state 00000000e12eaee8 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.727280:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.727287:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:2.0:1784044552.727291:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784044552.727295:0:22764:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044552.727416:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+27:18797:x1870705565276160:12345-192.168.202.40@tcp:36:dd.0 Request processed in 619us (838us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1784044552.727424:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000020:00080000:2.0:1784044552.727429:0:22764:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784044552.731773:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044552.731931:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565276288 00000100:00100000:1.0:1784044552.731943:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565276288 00000100:00100000:1.0:1784044552.732027:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:1.0:1784044552.732039:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+27:18797:x1870705565276288:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:1.0:1784044552.732068:0:24585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044552.732093:0:24585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3400/0x89871fc3aba1a0da lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d54 expref: -99 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.732170:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3400/0x89871fc3aba1a0da lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d54 expref: 28 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.732249:0:24585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3400/0x89871fc3aba1a0da lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d54 expref: 28 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044552.732276:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:1.0:1784044552.732279:0:24585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044552.732284:0:24585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38423a3400, rc 0) 00000100:00100000:1.0:1784044552.732352:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+28:18797:x1870705565276288:12345-192.168.202.40@tcp:101:dd.0 Request processed in 316us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044552.732360:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:1.0:1784044552.751263:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044552.751378:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565276544 00000100:00100000:2.0:1784044552.751390:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565276544 00000100:00100000:2.0:1784044552.751463:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:2.0:1784044552.751473:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+28:18797:x1870705565276544:12345-192.168.202.40@tcp:103:dd.0 00010000:00010000:2.0:1784044552.751511:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044552.751542:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3400/0x89871fc3aba1a0da lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d54 expref: 28 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044552.751566:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:2.0:1784044552.751571:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044552.751638:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+27:18797:x1870705565276544:12345-192.168.202.40@tcp:103:dd.0 Request processed in 166us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044552.751647:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:1.0:1784044552.760518:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044552.760770:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565276672 00000100:00100000:3.0:1784044552.760783:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565276672 00000100:00100000:3.0:1784044552.760902:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:3.0:1784044552.760914:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+27:18797:x1870705565276672:12345-192.168.202.40@tcp:58:dd.0 00010000:00010000:3.0:1784044552.761065:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044552.761104:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044552.761119:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044552.763871:0:22765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044552.763913:0:22765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1784044552.764213:0:22765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1784044552.764864:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+27:18797:x1870705565276672:12345-192.168.202.40@tcp:58:dd.0 Request processed in 3944us (4351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044552.764879:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:3.0:1784044552.766150:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044552.766236:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565276800 00000100:00100000:0.0:1784044552.766248:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565276800 00000100:00100000:0.0:1784044552.766310:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1784044552.766321:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+27:18797:x1870705565276800:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:0.0:1784044552.766352:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044552.766380:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a0e8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d5b expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.766451:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.766477:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a0e8 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d5b expref: 28 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.766500:0:22766:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.766515:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a0e8 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d5b expref: 28 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.766530:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:0.0:1784044552.766533:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784044552.766537:0:22766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a0e8 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d5b expref: 28 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044552.766545:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc600, rc 0) 00000100:00100000:0.0:1784044552.766604:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+28:18797:x1870705565276800:12345-192.168.202.40@tcp:101:dd.0 Request processed in 285us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044552.766612:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000040:00080000:2.0:1784044553.229549:0:22800:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1784044553.229562:0:22800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784044553.229599:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1784044553.229609:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1784044553.229870:0:22800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22800:1870705581135360:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784044553.231383:0:22800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27240 going to sleep for 11 seconds 00000100:00100000:2.0:1784044553.239733:0:22800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22800:1870705581135360:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784044553.251624:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044553.251898:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565276928 00000100:00100000:3.0:1784044553.251911:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565276928 00000100:00100000:3.0:1784044553.252319:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:3.0:1784044553.252334:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+28:18798:x1870705565276928:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784044553.252385:0:24585:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784044553.252552:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+28:18798:x1870705565276928:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 222us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044553.252562:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00080000:0.0:1784044553.258415:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044553.264308:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.264431:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565277056 00000100:00100000:2.0:1784044553.264444:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565277056 00000100:00100000:2.0:1784044553.264540:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:2.0:1784044553.264553:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+28:18798:x1870705565277056:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784044553.264650:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a0ef lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.264670:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a0ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.264689:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a0ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265009:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a0f6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265032:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265045:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265076:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a0fd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265086:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a0fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265093:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a0fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044553.265142:0:22764:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784044553.265146:0:22764:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044553.265159:0:22764:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a0fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265169:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a0ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265571:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a0ef lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265579:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a0ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265601:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044553.265605:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a0ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265613:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a0ef lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265625:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b397b61b600) 00010000:00010000:2.0:1784044553.265628:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044553.265633:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a0ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265639:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a0ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265655:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265661:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a0f6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265667:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265672:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044553.265674:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265681:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a0f6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265697:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9b397b61b900) 00010000:00010000:2.0:1784044553.265699:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044553.265702:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a0f6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265708:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a0f6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265721:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a0fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265727:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a0fd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265732:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a0fd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265737:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044553.265740:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a0fd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265746:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a0fd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265752:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:2.0:1784044553.265754:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044553.265757:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a0fd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.265763:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a0fd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044553.266006:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+28:18798:x1870705565277056:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 1451us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044553.266016:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:3.0:1784044553.278310:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044553.279010:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565277312 00000100:00100000:1.0:1784044553.279025:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565277312 00000100:00100000:1.0:1784044553.279101:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1784044553.279111:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+28:18798:x1870705565277312:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044553.279130:0:24585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044553.279151:0:24585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3000/0x89871fc3aba1a104 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d62 expref: -99 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279311:0:24585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a10b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279327:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a10b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279348:0:24585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a10b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044553.279374:0:24585:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784044553.279714:0:24585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a10b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279723:0:24585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a10b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279729:0:24585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a10b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279735:0:24585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044553.279739:0:24585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a10b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279746:0:24585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a10b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279758:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:1.0:1784044553.279761:0:24585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784044553.279766:0:24585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a10b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279771:0:24585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a10b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279808:0:24585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3000/0x89871fc3aba1a104 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d62 expref: 30 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279819:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b397b61b600) 00010000:00010000:1.0:1784044553.279821:0:24585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044553.279831:0:24585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3000/0x89871fc3aba1a104 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d62 expref: 30 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.279840:0:24585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38423a3000, rc 0) 00000100:00100000:1.0:1784044553.280005:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+29:18798:x1870705565277312:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 894us (1710us total) trans 12884901907 rc 301/301 00000100:00100000:1.0:1784044553.280013:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1784044553.292151:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044553.292318:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565277440 00000100:00100000:0.0:1784044553.292328:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565277440 00000100:00100000:0.0:1784044553.292379:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:0.0:1784044553.292398:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+29:18798:x1870705565277440:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784044553.292430:0:22766:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784044553.292547:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+29:18798:x1870705565277440:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 159us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044553.292571:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:3.0:1784044553.299832:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044553.300223:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565277696 00000100:00100000:1.0:1784044553.300232:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565277696 00000100:00100000:1.0:1784044553.300300:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:1.0:1784044553.300310:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+29:18798:x1870705565277696:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044553.300330:0:24585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044553.300349:0:24585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a119 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d69 expref: -99 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784044553.309832:0:24585:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:0.0:1784044553.309845:0:24585:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:0.0:1784044553.311668:0:24585:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:0.0:1784044553.313072:0:24585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a120 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.313094:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a120 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.313106:0:24585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a120 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.313197:0:24585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3a00/0x89871fc3aba1a119 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d69 expref: 32 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.313229:0:24585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a120 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d69 expref: 31 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.313238:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b39758be200) 00010000:00010000:0.0:1784044553.313241:0:24585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044553.313244:0:24585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fca00, rc 0) 00000100:00100000:0.0:1784044553.314583:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+31:18798:x1870705565277696:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 14267us (14760us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1784044553.314595:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:1.0:1784044553.345286:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044553.345378:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565277952 00000100:00100000:0.0:1784044553.345397:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565277952 00000100:00100000:0.0:1784044553.345454:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:0.0:1784044553.345478:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+31:18798:x1870705565277952:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784044553.345534:0:22766:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044553.345559:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a120 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d69 expref: 31 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345579:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b39758be200) 00010000:00010000:0.0:1784044553.345589:0:22766:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044553.345608:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a12e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345622:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a12e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345632:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a12e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345657:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a135 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x83445e1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345665:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a135 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83445e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345671:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a135 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83445e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345715:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a12e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345722:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a12e lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345738:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a12e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345745:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fcc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044553.345748:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a12e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345755:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a12e lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345764:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b3842777600) 00010000:00010000:0.0:1784044553.345767:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044553.345770:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a12e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345777:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1a12e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345786:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a135 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83445e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345792:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a135 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83445e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345798:0:22766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a135 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83445e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345802:0:22766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044553.345805:0:22766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a135 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83445e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.345819:0:22766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a135 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x83445e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.346059:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x83445e1a (ffff9b39758bed00) 00010000:00010000:0.0:1784044553.346062:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044553.346065:0:22766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a135 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x83445e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.346071:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba1a135 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x83445e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044553.346146:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+30:18798:x1870705565277952:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 670us (869us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784044553.346155:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:3.0:1784044553.360399:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.361494:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565278080 00000100:00100000:2.0:1784044553.361504:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565278080 00000100:00100000:2.0:1784044553.361572:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:2.0:1784044553.361581:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+30:18798:x1870705565278080:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044553.361599:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044553.361620:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a13c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d70 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.361654:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a143 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.361667:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a143 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.361678:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a143 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.361781:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a13c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d70 expref: 32 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.361801:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba1a143 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d70 expref: 31 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.361809:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b397b61b900) 00010000:00010000:2.0:1784044553.361817:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784044553.361822:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799e00, rc 0) 00000100:00100000:2.0:1784044553.363082:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+31:18798:x1870705565278080:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1497us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044553.363092:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:3.0:1784044553.369368:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.369702:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565278336 00000100:00100000:2.0:1784044553.369712:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565278336 00000100:00100000:2.0:1784044553.369761:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:2.0:1784044553.369769:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+31:18798:x1870705565278336:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784044553.369862:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.369879:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.369891:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044553.370050:0:22764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1784044553.370059:0:22764:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 746540883464ns, next at 747540881653ns, rc = 0 00000004:00010000:2.0:1784044553.370100:0:22764:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c7cab6a reply state 000000003567f1ea transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.370112:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.370120:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b397b61b900) 00010000:00010000:2.0:1784044553.370123:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1784044553.370126:0:22764:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044553.370245:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+33:18798:x1870705565278336:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 476us (885us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1784044553.370265:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:3.0:1784044553.376868:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.377608:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565278464 00000100:00100000:2.0:1784044553.377620:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565278464 00000100:00100000:2.0:1784044553.377688:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:2.0:1784044553.377699:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3976b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+33:18798:x1870705565278464:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044553.377724:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044553.377745:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a151 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d77 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.377797:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a151 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d77 expref: 34 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.377811:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a151 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d77 expref: 34 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.377838:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b397b61b900) 00010000:00010000:2.0:1784044553.377842:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044553.377846:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798c00, rc 0) 00000100:00100000:2.0:1784044553.378111:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3976b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+34:18798:x1870705565278464:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 413us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044553.378119:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:3.0:1784044553.386431:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044553.386577:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565278592 00000100:00100000:0.0:1784044553.386586:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565278592 00000100:00100000:0.0:1784044553.386635:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:0.0:1784044553.386644:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3976b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+5:2409:x1870705565278592:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784044553.386914:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3976b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+6:2409:x1870705565278592:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 269us (489us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1784044553.386922:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1784044553.391872:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.392044:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565278848 00000100:00100000:2.0:1784044553.392053:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565278848 00000100:00100000:2.0:1784044553.392110:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:2.0:1784044553.392119:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3976b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e67ce78-1674-4eab-b693-10f988e5915a+34:18798:x1870705565278848:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784044553.392624:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3976b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e67ce78-1674-4eab-b693-10f988e5915a+35:18798:x1870705565278848:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 504us (768us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1784044553.392644:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1784044553.396710:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.397229:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565279104 00000100:00100000:2.0:1784044553.397238:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565279104 00000100:00100000:2.0:1784044553.397298:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:2.0:1784044553.397308:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3976b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+35:18798:x1870705565279104:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784044553.397690:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3976b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+35:18798:x1870705565279104:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 382us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044553.397699:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:3.0:1784044553.408798:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.409001:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565279232 00000100:00100000:2.0:1784044553.409009:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565279232 00000100:00100000:2.0:1784044553.409068:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:2.0:1784044553.409077:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3976b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+35:18798:x1870705565279232:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044553.409098:0:22765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044553.409118:0:22765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a158 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d7e expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.409233:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba1a15f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.409247:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba1a15f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.409260:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba1a15f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044553.409303:0:22765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044553.409320:0:22765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba1a15f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.409369:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba1a158 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d7e expref: 37 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.409397:0:22765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba1a15f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d7e expref: 36 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.409406:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b397b61b900) 00010000:00010000:2.0:1784044553.409409:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784044553.409413:0:22765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798400, rc 0) 00000100:00100000:2.0:1784044553.409469:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3976b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+36:18798:x1870705565279232:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 392us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044553.409476:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1784044553.417261:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044553.417756:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565279360 00000100:00100000:1.0:1784044553.417767:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565279360 00000100:00100000:1.0:1784044553.417821:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1784044553.417830:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3976b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e67ce78-1674-4eab-b693-10f988e5915a+6:2410:x1870705565279360:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044553.418075:0:24275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044553.418095:0:24275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba1a166 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d85 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784044553.418121:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565c09, blocks: 0x0 00010000:00010000:1.0:1784044553.418140:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1784044553.418156:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044553.418167:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba1a166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d85 expref: 7 pid: 24275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.418222:0:24275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba1a166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d85 expref: 7 pid: 24275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.418237:0:24275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38423a2c00, rc 0) 00000100:00100000:1.0:1784044553.418294:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3976b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e67ce78-1674-4eab-b693-10f988e5915a+7:2410:x1870705565279360:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 465us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044553.418302:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1784044553.428764:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.435482:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565279616 00000100:00100000:2.0:1784044553.435497:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565279616 00000100:00100000:2.0:1784044553.435618:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:2.0:1784044553.435630:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3976b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+36:18798:x1870705565279616:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784044553.435754:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3976b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+36:18798:x1870705565279616:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 126us (6998us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044553.435762:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1784044553.442373:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044553.448602:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565279744 00000100:00100000:0.0:1784044553.448616:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565279744 00000100:00100000:2.0:1784044553.448768:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:2.0:1784044553.448781:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3976b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+36:18798:x1870705565279744:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784044553.455664:0:22744:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1784044553.455678:0:22744:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1784044553.455734:0:22744:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1784044553.455843:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.455856:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.455864:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.455871:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044553.455875:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.455884:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.455901:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b3842777600) 00010000:00010000:1.0:1784044553.455904:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1784044553.455913:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.455920:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba19ff3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456006:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456015:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456031:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456037:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044553.456040:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456047:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456055:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b3842777900) 00010000:00010000:0.0:1784044553.456058:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044553.456061:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456067:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba19f9f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456082:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456089:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456095:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456355:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044553.456358:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456375:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456392:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b3842777600) 00010000:00010000:0.0:1784044553.456395:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044553.456398:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456405:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3600/0x89871fc3aba19fa6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456418:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456424:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456431:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456436:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044553.456439:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456445:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456452:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9b397b61b300) 00010000:00010000:0.0:1784044553.456454:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044553.456457:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456468:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799200/0x89871fc3aba1a04e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456483:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456488:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456494:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456499:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044553.456503:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456509:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456516:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:0.0:1784044553.456518:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044553.456521:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456526:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba1a0d3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456534:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456540:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456550:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456555:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044553.456558:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456564:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456571:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b397b61b900) 00010000:00010000:0.0:1784044553.456573:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784044553.456576:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.456591:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a14a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044553.463542:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3976b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e67ce78-1674-4eab-b693-10f988e5915a+15:18798:x1870705565279744:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 14754us (21168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044553.463556:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:2.0:1784044553.466849:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044553.466904:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565279872 00000100:00100000:3.0:1784044553.466915:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565279872 00000100:00100000:3.0:1784044553.466966:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1784044553.466975:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+7:2409:x1870705565279872:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784044553.467220:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+7:2409:x1870705565279872:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 234us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044553.467228:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1784044553.468511:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044553.468528:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581135488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1784044553.468573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044553.469618:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581135488 00000100:00100000:0.0:1784044553.469627:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581135488 00000100:00100000:0.0:1784044553.469688:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784044553.469694:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044553.469700:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3976b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581135488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1784044553.469720:0:24585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565280128 00000100:00100000:1.0:1784044553.469725:0:24585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565280128 00000100:00100000:1.0:1784044553.469758:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:1.0:1784044553.469766:0:24585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+15:18798:x1870705565280128:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784044553.469807:0:24585:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784044553.469812:0:24274:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784044553.469817:0:24274:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1784044553.469819:0:24274:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1784044553.469832:0:24585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba1a15f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d7e expref: 15 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044553.469834:0:24274:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1784044553 -> 1784044553 00002000:00010000:0.0:1784044553.469840:0:24274:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1784044553.469858:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b397b61b900) 00010000:00010000:1.0:1784044553.469863:0:24585:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044553.469886:0:24585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba1a16d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.469899:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba1a16d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.469909:0:24585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba1a16d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044553.470011:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3976b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1870705581135488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 313us (1436us total) trans 12884901892 rc 0/0 00000004:00010000:1.0:1784044553.470016:0:24585:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085f3828d reply state 00000000a126e274 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba1a16d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.470029:0:24585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a2800/0x89871fc3aba1a16d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044553.470042:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1784044553.470054:0:24585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b397b61b900) 00010000:00010000:1.0:1784044553.470057:0:24585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044553.470060:0:24585:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1784044553.470092:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3843d4d880/2, rc 0, transno 12884901892 00000100:00100000:0.0:1784044553.470098:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581135488:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1784044553.470199:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044553.470533:0:24585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e67ce78-1674-4eab-b693-10f988e5915a+16:18798:x1870705565280128:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 767us (841us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1784044553.470540:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:1.0:1784044553.474715:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.474991:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565280256 00000100:00100000:2.0:1784044553.475000:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565280256 00000100:00100000:2.0:1784044553.475055:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:2.0:1784044553.475079:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e67ce78-1674-4eab-b693-10f988e5915a+7:18798:x1870705565280256:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044553.475098:0:24276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044553.475118:0:24276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d8c expref: -99 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.475147:0:24276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba1a166 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d85 expref: 8 pid: 24275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.475157:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044553.475162:0:24276:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044553.475168:0:24276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 8 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.475425:0:24276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba1a166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d85 expref: 8 pid: 24275 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.475440:0:24276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba1a166 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d85 expref: 8 pid: 24275 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044553.475454:0:24276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24276:1870705581135616:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044553.475517:0:24276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044553.480527:0:24276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24276:1870705581135616:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044553.480562:0:24276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 8 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.480584:0:24276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799000, rc 0) 00000100:00100000:0.0:1784044553.480649:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e67ce78-1674-4eab-b693-10f988e5915a+8:18798:x1870705565280256:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 5572us (5944us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044553.480658:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:2.0:1784044553.481236:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044553.481866:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565280384 00000100:00100000:0.0:1784044553.481875:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565280384 00010000:00010000:0.0:1784044553.481913:0:22751:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba1a166 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d85 expref: 8 pid: 24275 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044553.481946:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1784044553.481954:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e67ce78-1674-4eab-b693-10f988e5915a+8:2409:x1870705565280384:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044553.481968:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044553.481987:0:22751:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba1a166 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d85 expref: 8 pid: 24275 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.482000:0:22751:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba1a166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d85 expref: 8 pid: 24275 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.482040:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb4ac802/0x89871fc3aba1a166 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d85 expref: 8 pid: 24275 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.482055:0:22751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044553.482059:0:22751:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044553.482067:0:22751:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 7 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.482078:0:22751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 7 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.482110:0:22751:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 7 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044553.482124:0:22751:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22751:1870705581135744:192.168.202.40@tcp:105: 00000100:00100000:0.0:1784044553.482232:0:22751:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044553.488974:0:22751:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22751:1870705581135744:192.168.202.40@tcp:105: 00010000:00010000:0.0:1784044553.489000:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044553.489056:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e67ce78-1674-4eab-b693-10f988e5915a+7:2409:x1870705565280384:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 7101us (7821us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044553.489065:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:2.0:1784044553.491296:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044553.492839:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565280512 00000100:00100000:0.0:1784044553.492851:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565280512 00000100:00100000:1.0:1784044553.497063:0:24274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:1.0:1784044553.497076:0:24274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e67ce78-1674-4eab-b693-10f988e5915a+7:2410:x1870705565280512:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784044553.497268:0:24274:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784044553.497272:0:24274:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1784044552 00002000:00010000:1.0:1784044553.497275:0:24274:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1784044551 00002000:00010000:1.0:1784044553.497277:0:24274:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1784044553 -> 1784044552 00002000:00010000:1.0:1784044553.497280:0:24274:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1784044553.497581:0:24274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e67ce78-1674-4eab-b693-10f988e5915a+8:2410:x1870705565280512:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 505us (6291us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1784044553.497590:0:24274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:1.0:1784044553.505411:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044553.505550:0:25382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565280640 00000100:00100000:3.0:1784044553.505559:0:25382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565280640 00000100:00100000:3.0:1784044553.505612:0:25382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1784044553.505622:0:25382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+8:2410:x1870705565280640:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784044553.505686:0:25382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.505705:0:25382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 8 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.505714:0:25382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044553.505718:0:25382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044553.505724:0:25382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.505759:0:25382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 8 pid: 24276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.505772:0:25382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 8 pid: 24276 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044553.505787:0:25382:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3976b6dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25382:1870705581135872:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044553.505855:0:25382:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f256780 going to sleep for 11 seconds 00000100:00100000:3.0:1784044553.524507:0:25382:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3976b6dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25382:1870705581135872:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044553.524540:0:25382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044553.527764:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.527859:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565280768 00000100:00100000:2.0:1784044553.527868:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565280768 00010000:00010000:2.0:1784044553.527908:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 9 pid: 24276 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044553.527976:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:2.0:1784044553.527985:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+9:2410:x1870705565280768:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044553.528001:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044553.528022:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 9 pid: 24276 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.528035:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 9 pid: 24276 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.528071:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a174 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d8c expref: 9 pid: 24276 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.528088:0:22750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044553.528092:0:22750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044553.528098:0:22750:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.528107:0:22750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.528135:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044553.528239:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+8:2410:x1870705565280768:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 255us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044553.528246:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00010000:00010000:3.0:1784044553.529821:0:25382:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.529851:0:25382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.529877:0:25382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.529886:0:25382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.529894:0:25382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.529902:0:25382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044553.529907:0:25382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.529916:0:25382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.529931:0:25382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.529939:0:25382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1a17b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044553.530047:0:25382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e67ce78-1674-4eab-b693-10f988e5915a+7:2410:x1870705565280640:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 24424us (24642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044553.530840:0:25382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:1.0:1784044553.535920:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.536074:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565281024 00000100:00100000:2.0:1784044553.536083:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565281024 00000100:00100000:2.0:1784044553.536139:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:2.0:1784044553.536148:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+16:18798:x1870705565281024:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784044553.536265:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.536284:0:22765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a0cc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d4d expref: 16 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.536295:0:22765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.536338:0:22765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a0cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d4d expref: 16 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.536353:0:22765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a0cc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d4d expref: 16 pid: 22766 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044553.536367:0:22765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22765:1870705581136000:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044553.536444:0:22765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27840 going to sleep for 11 seconds 00000100:00100000:1.0:1784044553.542981:0:22765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22765:1870705581136000:192.168.202.40@tcp:104: 00010000:00010000:1.0:1784044553.543010:0:22765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044553.551427:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044553.551565:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565281152 00000100:00100000:3.0:1784044553.551575:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565281152 00010000:00010000:3.0:1784044553.551610:0:25108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a0cc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d4d expref: 17 pid: 22766 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044553.551648:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1784044553.551657:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e67ce78-1674-4eab-b693-10f988e5915a+17:2409:x1870705565281152:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044553.551678:0:25108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044553.551685:0:25108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a0cc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d4d expref: 17 pid: 22766 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.551697:0:25108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a0cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d4d expref: 17 pid: 22766 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.551719:0:25108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1a0cc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d4d expref: 17 pid: 22766 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.551734:0:25108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:3.0:1784044553.551740:0:25108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a0e8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d5b expref: 16 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.551750:0:25108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.551763:0:25108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.551771:0:25108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.551797:0:25108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044553.551847:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e67ce78-1674-4eab-b693-10f988e5915a+16:2409:x1870705565281152:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 191us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044553.551855:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00010000:00010000:1.0:1784044553.552510:0:22765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.552520:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.552691:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.552704:0:22765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a151 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d77 expref: 16 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.552713:0:22765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.552739:0:22765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a151 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d77 expref: 16 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.552752:0:22765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a151 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d77 expref: 16 pid: 22765 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044553.552765:0:22765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22765:1870705581136128:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044553.552826:0:22765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3945594240 going to sleep for 11 seconds 00000100:00100000:2.0:1784044553.561243:0:22765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22765:1870705581136128:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044553.561276:0:22765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044553.564121:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044553.564244:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565281280 00000100:00100000:3.0:1784044553.564253:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565281280 00010000:00010000:3.0:1784044553.564293:0:22750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a151 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d77 expref: 17 pid: 22765 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044553.564383:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1784044553.564393:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+17:2409:x1870705565281280:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044553.564408:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044553.564415:0:22750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a151 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d77 expref: 17 pid: 22765 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.564428:0:22750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a151 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d77 expref: 17 pid: 22765 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.564449:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798c00/0x89871fc3aba1a151 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d77 expref: 17 pid: 22765 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.564479:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b397b61b900) 00010000:00010000:3.0:1784044553.564484:0:22750:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.564494:0:22750:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.564502:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.564529:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044553.564584:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e67ce78-1674-4eab-b693-10f988e5915a+16:2409:x1870705565281280:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 191us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044553.564591:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00010000:00010000:2.0:1784044553.564642:0:22765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.564659:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044553.564768:0:22765:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:2.0:1784044553.564864:0:22765:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1784044553.564895:0:22765:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:2.0:1784044553.564962:0:22765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22765:1870705581136256:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784044553.566139:0:22765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044553.566170:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581136256 00000100:00100000:2.0:1784044553.566189:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581136256 00000100:00100000:2.0:1784044553.566232:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784044553.566239:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22765:x1870705581136256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784044553.566316:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22765:x1870705581136256:12345-0@lo:1000:mdt00_001.0 Request processed in 77us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044553.566322:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784044553.566353:0:22765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044553.566382:0:22765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22765:1870705581136256:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1784044553.566508:0:22765:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1784044553.566547:0:22765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22765:1870705581136384:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784044553.566569:0:22765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044553.566591:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581136384 00000100:00100000:2.0:1784044553.566594:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581136384 00000100:00100000:2.0:1784044553.566613:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784044553.566619:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22765:x1870705581136384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784044553.566728:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22765:x1870705581136384:12345-0@lo:1000:mdt00_001.0 Request processed in 108us (157us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1784044553.566746:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784044553.566765:0:22765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044553.566779:0:22765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22765:1870705581136384:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1784044553.566805:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566813:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566821:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566827:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38423a3200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044553.566831:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566839:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566850:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b397b61b900) 00010000:00010000:2.0:1784044553.566852:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044553.566856:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566862:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38423a3200/0x89871fc3aba1a189 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566889:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566896:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566907:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566912:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044553.566915:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566922:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566930:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:2.0:1784044553.566932:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044553.566937:0:22765:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a0e8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d5b expref: 19 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566949:0:22765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a0e8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d5b expref: 19 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.566957:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a0e8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d5b expref: 19 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.567015:0:22765:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1a0e8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d5b expref: 19 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044553.567027:0:22765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22765:1870705581136512:192.168.202.40@tcp:105: 00000100:00100000:2.0:1784044553.567070:0:22765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044553.574595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044553.574663:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565281408 00000100:00100000:3.0:1784044553.574680:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565281408 00000100:00100000:3.0:1784044553.574731:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1784044553.574740:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397c9c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+20:18797:x1870705565281408:12345-192.168.202.40@tcp:49:dd.0 00000100:00100000:3.0:1784044553.574864:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397c9c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+20:18797:x1870705565281408:12345-192.168.202.40@tcp:49:dd.0 Request processed in 124us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044553.574871:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:1.0:1784044553.579510:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044553.579596:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565281536 00000100:00100000:0.0:1784044553.579616:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565281536 00000100:00100000:0.0:1784044553.579675:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:0.0:1784044553.579684:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+20:18797:x1870705565281536:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:0.0:1784044553.579702:0:22766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044553.579721:0:22766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a190 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6d93 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.579754:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a197 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.579767:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 2/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.579776:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a197 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.579792:0:22766:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.579802:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a197 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044553.580557:0:22765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22765:1870705581136512:192.168.202.40@tcp:105: 00010000:00010000:2.0:1784044553.580591:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580599:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1a0e1 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580621:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a19e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580631:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a19e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580642:0:22765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a19e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580651:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a19e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580657:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a19e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580663:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a19e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580724:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044553.580728:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a19e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580735:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a19e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580746:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:2.0:1784044553.580754:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044553.580758:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a19e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580764:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799600/0x89871fc3aba1a19e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580776:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580782:0:22765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580788:0:22765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580793:0:22765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044553.580797:0:22765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580803:0:22765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580809:0:22765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:2.0:1784044553.580811:0:22765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784044553.580813:0:22765:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a197 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580821:0:22765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580827:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a197 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580894:0:22765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.580902:0:22765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba1a182 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044553.581061:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e67ce78-1674-4eab-b693-10f988e5915a+21:18798:x1870705565281024:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 44913us (45149us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1784044553.581070:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000020:00080000:2.0:1784044553.581075:0:22765:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784044553.581488:0:22800:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1784044553.581493:0:22800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044553.581520:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1784044553.581526:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1784044553.583318:0:22766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.583342:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a197 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.583461:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a190 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d93 expref: 21 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.583493:0:22766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1a197 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6d93 expref: 20 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.583502:0:22766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b397b61bf00) 00010000:00010000:0.0:1784044553.583504:0:22766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044553.583508:0:22766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd200, rc 0) 00000100:00100000:0.0:1784044553.583612:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e67ce78-1674-4eab-b693-10f988e5915a+20:18797:x1870705565281536:12345-192.168.202.40@tcp:101:dd.0 Request processed in 3928us (4108us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044553.583621:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1784044553.585934:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.594785:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565281792 00000100:00100000:2.0:1784044553.594799:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565281792 00000100:00100000:0.0:1784044553.601269:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:0.0:1784044553.601284:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+20:18798:x1870705565281792:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784044553.601529:0:22767:0:(mdd_object.c:4016:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784044553.601560:0:22767:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1784044553.601589:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a1a5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.601606:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a1a5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.601618:0:22767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a1a5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.601626:0:22767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a1a5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.601634:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a1a5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.601655:0:22767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a1a5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044553.601682:0:22767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784044553.603961:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e67ce78-1674-4eab-b693-10f988e5915a+22:18798:x1870705565281792:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 2671us (18026us total) trans 12884901918 rc 0/0 00010000:00010000:2.0:1784044553.604040:0:23922:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044553.604056:0:23922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a1a5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.604066:0:23922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fca00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044553.604070:0:23922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a1a5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.604079:0:23922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a1a5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.604094:0:23922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b397b61b900) 00010000:00010000:2.0:1784044553.604097:0:23922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784044553.604102:0:23922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a1a5 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.604108:0:23922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1a1a5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.604139:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044553.604141:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044553.604143:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044553.604594:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000020:00080000:0.0:1784044553.604601:0:22767:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784044553.649293:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.649453:0:24280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565281920 00000100:00100000:2.0:1784044553.649472:0:24280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565281920 00000100:00100000:2.0:1784044553.649541:0:24280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1784044553.649551:0:24280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3976b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e67ce78-1674-4eab-b693-10f988e5915a+7:2409:x1870705565281920:12345-192.168.202.40@tcp:4:dd.0 00002000:00010000:2.0:1784044553.649596:0:24280:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a565c08, atime: 0x6a565c07, ctime: 0x6a565c08, blocks: 0x0 00010000:00010000:2.0:1784044553.649615:0:24280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a1ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.649632:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=746s v=(0 0) 00010000:00010000:2.0:1784044553.649636:0:24280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044553.649643:0:24280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a1ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.649656:0:24280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a1ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044553.670612:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044553.671153:0:24281:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044553.671164:0:24281:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1784044553.674868:0:24281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565282048 00000100:00100000:0.0:1784044553.674883:0:24281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565282048 00000100:00100000:2.0:1784044553.676495:0:25814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:2.0:1784044553.676508:0:25814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3976b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e67ce78-1674-4eab-b693-10f988e5915a+9:2409:x1870705565282048:12345-192.168.202.40@tcp:4:dd.0 00010000:00010000:2.0:1784044553.676543:0:25814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba1a1b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.676573:0:25814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044553.676578:0:25814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044553.676584:0:25814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba1a1b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.676597:0:25814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba1a1b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044553.747023:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784044553.761522:0:25091:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:2.0:1784044553.761541:0:25091:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:3.0:1784044553.762401:0:24280:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1784044553.762412:0:24280:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1784044552 -> 1784044553 00002000:00010000:3.0:1784044553.762415:0:24280:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1784044552 -> 1784044553 00002000:00010000:3.0:1784044553.762418:0:24280:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:3.0:1784044553.762439:0:24280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a1ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.762454:0:24280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a1ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.762464:0:24280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a1ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.762472:0:24280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044553.762477:0:24280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a1ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.762488:0:24280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a1ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.762512:0:24280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a1ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044553.762520:0:24280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dcd3296/0x89871fc3aba1a1ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044553.762618:0:24280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3976b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e67ce78-1674-4eab-b693-10f988e5915a+7:2409:x1870705565281920:12345-192.168.202.40@tcp:4:dd.0 Request processed in 113062us (113327us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1784044553.762649:0:24280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000001:00080000:3.0:1784044553.788682:0:25091:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1784044553.789012:0:25814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1784044553.789017:0:25814:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1784044553.789034:0:25814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba1a1b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.789057:0:25814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba1a1b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.789067:0:25814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba1a1b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.789074:0:25814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799600 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044553.789080:0:25814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba1a1b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.789088:0:25814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba1a1b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.789120:0:25814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba1a1b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044553.789128:0:25814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba1a1b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044553.789379:0:25814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3976b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e67ce78-1674-4eab-b693-10f988e5915a+5:2409:x1870705565282048:12345-192.168.202.40@tcp:4:dd.0 Request processed in 112864us (118766us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1784044553.789390:0:25814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00010000:00010000:1.0:1784044554.765475:0:22752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044554.829798:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581136640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044554.829858:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044554.829960:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581136640 00000100:00100000:2.0:1784044554.829966:0:23783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581136640 00000100:00100000:2.0:1784044554.830007:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784044554.830013:0:23783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581136640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044554.830040:0:23783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1784044554.830084:0:23783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581136640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044554.830092:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784044554.830110:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044554.830118:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581136768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044554.830139:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044554.830214:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581136640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044554.830241:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581136768 00000100:00100000:2.0:1784044554.830244:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581136768 00000100:00100000:2.0:1784044554.830278:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044554.830285:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581136768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044554.830318:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044554.830349:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581136768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044554.830354:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1784044554.830366:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044554.830382:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581136768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044554.830717:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581136896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044554.830737:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044554.831123:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581136896 00000100:00100000:1.0:1784044554.831127:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581136896 00000100:00100000:1.0:1784044554.831161:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784044554.831166:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581136896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044554.831635:0:22770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784044554.831680:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581136896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 514us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044554.831685:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784044554.831759:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581136896:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1784044555.663494:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044555.789410:0:23922:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784044555.803065:0:25851:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1784044555.853620:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581137024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044555.855148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044555.855246:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044555.855260:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581137152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044555.857355:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581137408:0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.857441:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044555.857481:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581137920:0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.857509:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044555.857529:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581138432:0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.857554:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044555.857587:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784044555.857593:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccdc2386-7f06-47a4-81d1-1145948bf326:3641:1870705581137280:0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.857621:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044555.857648:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581137792:0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.857668:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044555.857683:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581138304:0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.857717:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044555.857756:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581137408 00000100:00100000:2.0:1784044555.857771:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581137408 00000100:00100000:2.0:1784044555.857823:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581137792 00000100:00100000:2.0:1784044555.857826:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581137792 00000100:00100000:2.0:1784044555.857842:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784044555.857851:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581137408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.857908:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581137408:12345-0@lo:400:kworker.0 Request processed in 58us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044555.857916:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784044555.858149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044555.858209:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581137536:0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.858237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044555.858256:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581138048:0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.858279:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044555.859271:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581137024 00000100:00100000:1.0:1784044555.859296:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581137024 00000100:00100000:1.0:1784044555.859360:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581137152 00000100:00100000:1.0:1784044555.859364:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581137152 00000100:00100000:1.0:1784044555.859387:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044555.859396:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581137024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044555.859431:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3908202496 avail 3676680192 00000100:00100000:1.0:1784044555.859497:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581137024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (4358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044555.859504:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044555.859522:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044555.859529:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581137152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044555.859540:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3908202496 avail 3676680192 00000100:00100000:1.0:1784044555.859565:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581137152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044555.859570:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044555.859595:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581137664:0@lo:400:kworker.0 00000100:00100000:1.0:1784044555.859630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044555.859658:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581138176:0@lo:400:kworker.0 00000100:00100000:1.0:1784044555.859701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044555.859722:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581138688:0@lo:400:kworker.0 00000100:00100000:1.0:1784044555.859745:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044555.859916:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581138560:0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.860399:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044555.860452:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581137152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044555.860466:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1784044555.860481:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3843d4d880, transno 12884901892 00000004:00080000:0.0:1784044555.860497:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1784044555.860533:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581137024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044555.860577:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581137920 00000100:00100000:0.0:1784044555.860582:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581137920 00000100:00100000:0.0:1784044555.860623:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581137536 00000100:00100000:0.0:1784044555.860627:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581137536 00000100:00100000:0.0:1784044555.860646:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581138048 00000100:00100000:0.0:1784044555.860650:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581138048 00000100:00100000:0.0:1784044555.860687:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784044555.860693:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581137920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.860738:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581137920:12345-0@lo:400:kworker.0 Request processed in 45us (3227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044555.860745:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784044555.860760:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784044555.860766:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581137536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.860798:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581137536:12345-0@lo:400:kworker.0 Request processed in 32us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044555.860805:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784044555.860816:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044555.860822:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581138048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.860848:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581138048:12345-0@lo:400:kworker.0 Request processed in 27us (2568us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044555.860854:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044555.860883:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581138432 00000100:00100000:0.0:1784044555.860888:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581138432 00000100:00100000:0.0:1784044555.860911:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581138304 00000100:00100000:0.0:1784044555.860920:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581138304 00000100:00100000:0.0:1784044555.860953:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581137664 00000100:00100000:0.0:1784044555.860957:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581137664 00000100:00100000:0.0:1784044555.860969:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581138176 00000100:00100000:0.0:1784044555.860971:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581138176 00000100:00100000:0.0:1784044555.860983:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581138688 00000100:00100000:0.0:1784044555.860985:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581138688 00000100:00100000:0.0:1784044555.860996:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581138560 00000100:00100000:0.0:1784044555.860999:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581138560 00000100:00100000:0.0:1784044555.861013:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784044555.861019:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581138432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.861055:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581138432:12345-0@lo:400:kworker.0 Request processed in 35us (3498us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044555.861061:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784044555.861073:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784044555.861079:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581138304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.861108:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581138304:12345-0@lo:400:kworker.0 Request processed in 29us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044555.861116:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784044555.861127:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784044555.861132:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581137664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.861163:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581137664:12345-0@lo:400:kworker.0 Request processed in 30us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044555.861168:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784044555.861217:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784044555.861223:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581138176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.861249:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581138176:12345-0@lo:400:kworker.0 Request processed in 26us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044555.861266:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784044555.861279:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784044555.861297:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581138688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.861328:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581138688:12345-0@lo:400:kworker.0 Request processed in 44us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044555.861334:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784044555.861347:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784044555.861353:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705581138560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.861380:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705581138560:12345-0@lo:400:kworker.0 Request processed in 28us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044555.861386:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784044555.861576:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581137536:0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.861591:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581138048:0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.861603:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581138560:0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.861646:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581137664:0@lo:400:kworker.0 00000100:00100000:0.0:1784044555.861659:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581138176:0@lo:400:kworker.0 00010000:00080000:0.0:1784044555.861676:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d2d500 x1870705581138688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044555.861688:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581138688:0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.861829:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784044555.861842:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581137792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.861890:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581137792:12345-0@lo:400:kworker.0 Request processed in 53us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044555.861895:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784044555.861919:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581137280 00000100:00100000:2.0:1784044555.861924:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581137280 00000100:00100000:2.0:1784044555.861954:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784044555.861961:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:3641:x1870705581137280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.861993:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccdc2386-7f06-47a4-81d1-1145948bf326+24:3641:x1870705581137280:12345-0@lo:400:kworker.0 Request processed in 33us (4371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044555.861998:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1784044555.862041:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044555.862047:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044555.862050:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784044555.862053:0:22760:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044555.862077:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccdc2386-7f06-47a4-81d1-1145948bf326:3641:1870705581137280:0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.862090:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581137792:0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.862103:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581138304:0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.862129:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581137408:0@lo:400:kworker.0 00000100:00100000:2.0:1784044555.862143:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581137920:0@lo:400:kworker.0 00010000:00080000:2.0:1784044555.862156:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d2df80 x1870705581138432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044555.862166:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581138432:0@lo:400:kworker.0 00010000:00010000:1.0:1784044556.813418:0:22753:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044556.878748:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581138816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044556.878843:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044556.879015:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581138816 00000100:00100000:2.0:1784044556.879024:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581138816 00000100:00100000:2.0:1784044556.879075:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784044556.879086:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581138816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044556.879117:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044556.879171:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581138816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044556.879207:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784044556.879287:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581138816:0@lo:13:osp-pre-0-0.0 Debug log: 14388 lines, 14388 kept, 0 dropped, 0 bad.