00010000:00010000:2.0F:1790779259.433077:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0F:1790779260.013122:0:17126:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1790779260.013153:0:17126:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b7705328e40 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1790779260.013158:0:17126:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b77083b8700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b7705328240 00000020:00080000:0.0:1790779260.013163:0:17126:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b77083b8600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b7741e3be00 00000020:00080000:3.0F:1790779260.013215:0:17186:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1790779260.013292:0:17186:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1790779260.020651:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779260.020670:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779260.020678:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779260.020684:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779260.020689:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779260.020698:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779260.020717:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:2.0:1790779260.020720:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779260.020725:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779260.020731:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b770894b200/0xb1aa4014e936e461 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779260.456438:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779260.605586:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779260.605632:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779260.605671:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779260.605694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779260.605712:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779260.605732:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779260.605748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779260.605763:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779260.605822:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779260.605856:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642820480 00000100:00100000:3.0:1790779260.605874:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642820480 00000100:00100000:3.0:1790779260.605937:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642820352 00000100:00100000:3.0:1790779260.605940:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642820352 00000100:00100000:3.0:1790779260.605990:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642820864 00000100:00100000:3.0:1790779260.605994:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642820864 00000100:00100000:3.0:1790779260.606018:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642820992 00000100:00100000:3.0:1790779260.606020:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642820992 00000100:00100000:3.0:1790779260.606034:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:3.0:1790779260.606043:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642820480:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779260.606110:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642820480:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 68us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779260.606117:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 79 00000100:00100000:3.0:1790779260.606132:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:3.0:1790779260.606139:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+13:2400:x1877767642820352:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779260.606162:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+13:2400:x1877767642820352:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779260.606184:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 80 00000100:00100000:3.0:1790779260.606200:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:3.0:1790779260.606210:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cb4944-c4c7-43b5-9787-d954585b459c+6:2400:x1877767642820864:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779260.606217:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:2.0:1790779260.606230:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+5:2401:x1877767642820992:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779260.606242:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10cb4944-c4c7-43b5-9787-d954585b459c+6:2400:x1877767642820864:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 34us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779260.606248:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 81 00000100:00100000:2.0:1790779260.606270:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+5:2401:x1877767642820992:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 43us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779260.606277:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 82 00000100:00100000:2.0:1790779260.606299:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642820608 00000100:00100000:2.0:1790779260.606303:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642820608 00000100:00100000:2.0:1790779260.606330:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642820736 00000100:00100000:2.0:1790779260.606333:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642820736 00000100:00100000:2.0:1790779260.606344:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642821120 00000100:00100000:2.0:1790779260.606347:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642821120 00000100:00100000:2.0:1790779260.606373:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642821248 00000100:00100000:2.0:1790779260.606376:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642821248 00000100:00100000:2.0:1790779260.606391:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:2.0:1790779260.606397:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642820608:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779260.606425:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642820608:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779260.606432:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:2.0:1790779260.606444:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:2.0:1790779260.606450:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2397:x1877767642820736:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:2.0:1790779260.606467:0:18654:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e197 00000100:00080000:2.0:1790779260.606482:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9b772012a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790779260.606523:0:18654:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790779260.606639:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+2:2397:x1877767642820736:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 188us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779260.606646:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:2.0:1790779260.606661:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0F:1790779260.606665:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642820224 00000100:00100000:2.0:1790779260.606668:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cb4944-c4c7-43b5-9787-d954585b459c+5:2397:x1877767642821120:12345-192.168.203.3@tcp:9:kworker.0 00000100:00100000:1.0:1790779260.606678:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642820224 00000020:00000080:2.0:1790779260.606679:0:18654:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e1cf 00000100:00080000:2.0:1790779260.606687:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9b773c020000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790779260.606710:0:18654:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1790779260.606716:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 169 00000100:00100000:1.0:1790779260.606725:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2400:x1877767642820224:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779260.606758:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2400:x1877767642820224:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 35us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779260.606765:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 169 00000100:00100000:2.0:1790779260.606790:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cb4944-c4c7-43b5-9787-d954585b459c+2:2397:x1877767642821120:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 121us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779260.606799:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:2.0:1790779260.606822:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:2.0:1790779260.606828:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cb4944-c4c7-43b5-9787-d954585b459c+5:2397:x1877767642821248:12345-192.168.203.3@tcp:9:kworker.0 00000020:00000080:2.0:1790779260.606929:0:18654:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e1d6 00000100:00080000:2.0:1790779260.606936:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9b773c022000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790779260.606969:0:18654:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790779260.607017:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10cb4944-c4c7-43b5-9787-d954585b459c+2:2397:x1877767642821248:12345-192.168.203.3@tcp:9:kworker.0 Request processed in 189us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779260.607024:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00010000:00010000:2.0:1790779260.607106:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779260.607112:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790779260.607486:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790779260.607492:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790779260.607495:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790779260.607497:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1790779260.609069:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779261.406739:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779261.406911:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642821376 00000100:00100000:3.0:1790779261.406922:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642821376 00000100:00100000:3.0:1790779261.407003:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1790779261.407015:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+13:15556:x1877767642821376:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790779261.407127:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+13:15556:x1877767642821376:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 114us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779261.407135:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 65 00000100:00100000:3.0:1790779261.413123:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779261.414413:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642821504 00000100:00100000:2.0:1790779261.414426:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642821504 00000100:00100000:2.0:1790779261.414499:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:2.0:1790779261.414510:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:15556:x1877767642821504:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790779261.414641:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:15556:x1877767642821504:12345-192.168.203.3@tcp:60:lhsmtool_posix.0 Request processed in 133us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779261.414649:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 66 00000100:00100000:0.0:1790779261.431017:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779261.431114:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642821760 00000100:00100000:3.0:1790779261.431124:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642821760 00000100:00100000:3.0:1790779261.431200:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1790779261.431212:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+13:15556:x1877767642821760:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790779261.431477:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+14:15556:x1877767642821760:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 267us (468us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1790779261.431486:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00010000:00010000:2.0:1790779261.480124:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779261.544501:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790779261.544526:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663865088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779261.544597:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779261.547607:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663865088 00000100:00100000:1.0:1790779261.547638:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663865088 00000100:00100000:1.0:1790779261.547710:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790779261.547722:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663865088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790779261.547759:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790779261.547851:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663865088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (3252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779261.547871:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790779261.547952:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663865088:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790779261.548513:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790779262.504263:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779262.570796:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779262.570820:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663865216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779262.571012:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779262.571235:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663865216 00000100:00100000:1.0:1790779262.571244:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663865216 00000100:00100000:1.0:1790779262.571358:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790779262.571368:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663865216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790779262.571391:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790779262.571453:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b772fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663865216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779262.571460:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1790779262.571521:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779262.571563:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663865216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779263.081073:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779263.081097:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663865344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779263.081167:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779263.081244:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663865344 00000100:00100000:2.0:1790779263.081251:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663865344 00000100:00100000:2.0:1790779263.081293:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790779263.081301:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663865344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779263.081332:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1790779263.081384:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663865344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779263.081391:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790779263.081437:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663865344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779263.085691:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663865472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779263.087876:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779263.087970:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663865472 00000100:00100000:3.0:1790779263.087978:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663865472 00000100:00100000:3.0:1790779263.088575:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790779263.088589:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76045fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663865472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779263.088627:0:18106:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790779263.088692:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76045fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663865472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779263.088699:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790779263.088748:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663865472:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1790779263.203994:0:20523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 10:41:01 (1790779261) 00000040:00080000:2.0:1790779263.276522:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790779263.276532:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790779263.276569:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790779263.276577:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1790779263.535659:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779263.592700:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663865600:0@lo:400:kworker.0 00000100:00100000:0.0:1790779263.592786:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779263.592915:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663865600 00000100:00100000:2.0:1790779263.592925:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663865600 00000100:00100000:2.0:1790779263.592975:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790779263.592984:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3651:x1877767663865600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779263.593184:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663865984:0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.597039:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3651:x1877767663865600:12345-0@lo:400:kworker.0 Request processed in 4047us (4243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779263.597054:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790779263.597120:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663865856:0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.597158:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779263.597196:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663866368:0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.597221:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779263.597244:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663866880:0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.597614:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779263.597661:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663865856 00000100:00100000:2.0:1790779263.597669:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663865856 00000100:00100000:2.0:1790779263.597723:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790779263.597732:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663865856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.597796:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663865856:12345-0@lo:400:kworker.0 Request processed in 66us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779263.597945:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790779263.597969:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663866368 00000100:00100000:2.0:1790779263.597973:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663866368 00000100:00100000:2.0:1790779263.597998:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663866880 00000100:00100000:2.0:1790779263.598001:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663866880 00000100:00100000:2.0:1790779263.598022:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790779263.598028:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663866368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.598065:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663866368:12345-0@lo:400:kworker.0 Request processed in 36us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779263.598071:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790779263.598086:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790779263.598093:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663866880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.598122:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663866880:12345-0@lo:400:kworker.0 Request processed in 30us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779263.598129:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1790779263.598148:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779263.598153:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779263.598190:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663865856:0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.598201:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663866368:0@lo:400:kworker.0 00010000:00080000:2.0:1790779263.598212:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603831880 x1877767663866880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779263.598222:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663866880:0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.599298:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779263.599342:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663866496:0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.599375:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779263.599412:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663865984 00000100:00100000:2.0:1790779263.599418:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663865984 00000100:00100000:2.0:1790779263.599451:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663866496 00000100:00100000:2.0:1790779263.599454:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663866496 00000100:00100000:2.0:1790779263.599480:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790779263.599488:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663865984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.599529:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663865984:12345-0@lo:400:kworker.0 Request processed in 41us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779263.599535:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790779263.599548:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790779263.599553:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663866496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.599578:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663866496:12345-0@lo:400:kworker.0 Request processed in 25us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779263.599584:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1790779263.599603:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779263.599624:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663866496:0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.599631:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663867008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779263.599657:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779263.599696:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663865984:0@lo:400:kworker.0 00000100:00100000:0.0:1790779263.600071:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663865600:0@lo:400:kworker.0 00000100:00100000:0.0:1790779263.600090:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663866112:0@lo:400:kworker.0 00000100:00100000:0.0:1790779263.600121:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779263.600186:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663866624:0@lo:400:kworker.0 00000100:00100000:0.0:1790779263.600209:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779263.600235:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663867136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779263.600257:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779263.600278:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790779263.600285:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663865728:0@lo:400:kworker.0 00000100:00100000:0.0:1790779263.600309:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779263.600622:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663866624 00000100:00100000:1.0:1790779263.600628:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663866624 00000100:00100000:1.0:1790779263.600675:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790779263.600683:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663866624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779263.600722:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663866624:12345-0@lo:400:kworker.0 Request processed in 41us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779263.600728:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1790779263.603797:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790779263.605016:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663866240:0@lo:400:kworker.0 00000100:00100000:0.0:1790779263.605083:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779263.606200:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663866112 00000100:00100000:2.0:1790779263.606212:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663866112 00000100:00100000:2.0:1790779263.606265:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663865728 00000100:00100000:2.0:1790779263.606269:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663865728 00000100:00100000:2.0:1790779263.606301:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790779263.606310:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663866112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.606380:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663866112:12345-0@lo:400:kworker.0 Request processed in 71us (6258us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779263.606399:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790779263.606415:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790779263.606421:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663865728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.606450:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663865728:12345-0@lo:400:kworker.0 Request processed in 30us (6142us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779263.606455:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1790779263.606477:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779263.606554:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663866752:0@lo:400:kworker.0 00000100:00100000:0.0:1790779263.606593:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779263.606634:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663866112:0@lo:400:kworker.0 00010000:00080000:0.0:1790779263.606648:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7603830e00 x1877767663866624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779263.606657:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663866624:0@lo:400:kworker.0 00000100:00100000:0.0:1790779263.606681:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663865728:0@lo:400:kworker.0 00000100:00100000:0.0:1790779263.606701:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663867008 00000100:00100000:0.0:1790779263.606705:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663867008 00000100:00100000:0.0:1790779263.606725:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663867136 00000100:00100000:0.0:1790779263.606728:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663867136 00000100:00100000:0.0:1790779263.606749:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790779263.606755:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663867008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779263.606778:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779263.606820:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663867008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (7161us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779263.606827:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790779263.606851:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790779263.606857:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663867136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779263.606867:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779263.606920:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663867136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (6662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779263.606926:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790779263.606943:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779263.606964:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663867136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779263.606996:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663867008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779263.607088:0:18654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663866240 00000100:00100000:2.0:1790779263.607093:0:18654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663866240 00000100:00100000:2.0:1790779263.607115:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790779263.607121:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663866240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779263.607153:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663866240:12345-0@lo:400:kworker.0 Request processed in 32us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779263.607159:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790779263.607224:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663866240:0@lo:400:kworker.0 00000100:00100000:1.0:1790779263.607296:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663866752 00000100:00100000:1.0:1790779263.607301:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663866752 00000100:00100000:1.0:1790779263.607340:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790779263.607347:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663866752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779263.607383:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663866752:12345-0@lo:400:kworker.0 Request processed in 38us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779263.607389:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1790779263.607462:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779263.607482:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663866752:0@lo:400:kworker.0 00010000:00010000:2.0:1790779264.553307:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779265.592577:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779265.715793:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779265.716100:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779265.716135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779265.716154:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779265.716178:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779265.716200:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779265.716231:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642822144 00000100:00100000:1.0:1790779265.716243:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642822144 00000100:00100000:1.0:1790779265.716565:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642822400 00000100:00100000:1.0:1790779265.716570:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642822400 00000100:00100000:1.0:1790779265.716586:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642822016 00000100:00100000:1.0:1790779265.716589:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642822016 00000100:00100000:1.0:1790779265.716613:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642822528 00000100:00100000:1.0:1790779265.716615:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642822528 00000100:00100000:1.0:1790779265.716634:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:1.0:1790779265.716665:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642822144:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779265.718505:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:3.0:1790779265.718545:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+6:2400:x1877767642822400:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779265.718685:0:17148:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1790779265.718699:0:17148:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:0.0:1790779265.718732:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779265.718749:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779265.719649:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642822144:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 2977us (3539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779265.719662:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:1.0:1790779265.719707:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:1.0:1790779265.719720:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+14:2400:x1877767642822016:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779265.719924:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+6:2400:x1877767642822400:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1402us (3786us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779265.719933:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 90 00000100:00100000:3.0:1790779265.719951:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 92 00000100:00100000:3.0:1790779265.719984:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+5:2400:x1877767642822528:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779265.720463:0:17140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642821888 00000100:00100000:2.0:1790779265.720475:0:17140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642821888 00000100:00100000:2.0:1790779265.720535:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:2.0:1790779265.720543:0:17140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2400:x1877767642821888:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779265.720586:0:17140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2400:x1877767642821888:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 45us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779265.720594:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 171 00000100:00100000:2.0:1790779265.720633:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642822272 00000100:00100000:2.0:1790779265.720637:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642822272 00000100:00100000:2.0:1790779265.720681:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:2.0:1790779265.720695:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642822272:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779265.720725:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2400:x1877767642822272:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 31us (4546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779265.720732:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00080000:2.0:1790779265.720771:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779265.721502:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+14:2400:x1877767642822016:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1781us (5340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779265.721514:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 91 00000100:00100000:3.0:1790779265.735672:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+5:2400:x1877767642822528:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 15675us (19448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779265.735694:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 92 00000001:00100000:0.0:1790779266.155120:0:18648:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10cb4944-c4c7-43b5-9787-d954585b459c 00000020:00000080:0.0:1790779266.155134:0:18648:0:(genops.c:885:class_export_put()) final put ffff9b773c026800/10cb4944-c4c7-43b5-9787-d954585b459c 00000020:00000080:2.0:1790779266.156259:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773c026800/10cb4944-c4c7-43b5-9787-d954585b459c for lustre-OST0000 00000020:00000080:2.0:1790779266.156334:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773c020000 for lustre-OST0000 00000001:00080000:1.0:1790779266.160412:0:17126:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000001:00100000:0.0:1790779266.160426:0:19466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10cb4944-c4c7-43b5-9787-d954585b459c 00000020:00080000:1.0:1790779266.160432:0:17126:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00000080:0.0:1790779266.160440:0:19466:0:(genops.c:885:class_export_put()) final put ffff9b773c021000/10cb4944-c4c7-43b5-9787-d954585b459c 00000001:00100000:0.0:1790779266.160483:0:19466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000020:00000080:0.0:1790779266.160487:0:19466:0:(genops.c:885:class_export_put()) final put ffff9b772012f000/0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000020:00080000:3.0:1790779266.161092:0:17186:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1790779266.161105:0:17186:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00000080:2.0:1790779266.161969:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773c021000/10cb4944-c4c7-43b5-9787-d954585b459c for lustre-OST0001 00000020:00000080:2.0:1790779266.162051:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b772012f000/0e04fb1a-50ac-430a-9a7f-cdeca654586e for lustre-OST0001 00000020:00000080:2.0:1790779266.162084:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773c022000 for lustre-OST0001 00000020:00000080:2.0:1790779266.162094:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b772012a800 for lustre-OST0001 00010000:00010000:1.0:1790779266.602717:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779266.664345:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779266.664390:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663867264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779266.664483:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779266.665440:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663867264 00000100:00100000:3.0:1790779266.665455:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663867264 00000100:00100000:3.0:1790779266.665783:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790779266.665807:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663867264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790779266.665876:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790779266.666003:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663867264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 209us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779266.666011:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790779266.666243:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663867264:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790779266.667020:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779267.208316:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779267.208462:0:17150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642822784 00000100:00100000:3.0:1790779267.208472:0:17150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642822784 00000100:00100000:3.0:1790779267.208550:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:3.0:1790779267.208570:0:17150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+13:16311:x1877767642822784:12345-192.168.203.3@tcp:35:umount.0 00000001:00080000:3.0:1790779267.208803:0:17150:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00080000:2.0:1790779267.208951:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1790779267.209027:0:17150:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:3.0:1790779267.209151:0:17150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e04fb1a-50ac-430a-9a7f-cdeca654586e+16:16311:x1877767642822784:12345-192.168.203.3@tcp:35:umount.0 Request processed in 591us (844us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1790779267.209160:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000020:00080000:3.0:1790779267.209165:0:17150:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1790779267.214654:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779267.214981:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779267.215082:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779267.215099:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642822912 00000100:00100000:2.0:1790779267.215109:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642822912 00000100:00100000:3.0:1790779267.215126:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642823168 00000100:00100000:3.0:1790779267.215131:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642823168 00000100:00100000:3.0:1790779267.215177:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:3.0:1790779267.215206:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+14:2398:x1877767642822912:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779267.215222:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779267.215243:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768600/0xb1aa4014e936e16d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b70 expref: 14 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779267.215260:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779267.215309:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2398:x1877767642822912:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 107us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779267.215523:0:17131:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790779267.215533:0:17131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1790779267.215650:0:17132:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790779267.215658:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642823040 00000100:00100000:2.0:1790779267.215662:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642823040 00000100:00100000:0.0:1790779267.216132:0:20633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1790779267.216141:0:20633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b774205a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+14:2398:x1877767642823168:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779267.216150:0:20633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779267.216163:0:20633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768800/0xb1aa4014e936e1f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c57 expref: 14 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779267.216173:0:20633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779267.216251:0:20633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b774205a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+13:2398:x1877767642823168:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 109us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779267.216266:0:20633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1790779267.216295:0:20633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1790779267.216301:0:20633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+12:2398:x1877767642823040:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779267.216308:0:20633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779267.216317:0:20633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662000/0xb1aa4014e936e174 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ba1 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779267.216326:0:20633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779267.216345:0:20633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:2398:x1877767642823040:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 45us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779267.216352:0:20633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1790779267.221106:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1790779267.222065:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779267.222697:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642823296 00000100:00100000:1.0:1790779267.222707:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642823296 00000100:00100000:1.0:1790779267.222788:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:1.0:1790779267.222799:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2397:x1877767642823296:12345-192.168.203.3@tcp:9:umount.0 00000020:00000080:1.0:1790779267.222858:0:19170:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e190 00000100:00080000:1.0:1790779267.222868:0:19170:0:(import.c:65:import_set_state_nolock()) ffff9b772012e000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1790779267.222903:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1790779267.222941:0:19170:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1790779267.223098:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e04fb1a-50ac-430a-9a7f-cdeca654586e+2:2397:x1877767642823296:12345-192.168.203.3@tcp:9:umount.0 Request processed in 301us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779267.223106:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00080000:2.0:1790779267.223610:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779267.237225:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779267.237330:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642824192 00000100:00100000:0.0:1790779267.237341:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642824192 00000100:00100000:0.0:1790779267.237421:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 67 00000100:00100000:0.0:1790779267.237431:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+16:2397:x1877767642824192:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:0.0:1790779267.237468:0:17148:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e182 00000020:00010000:0.0:1790779267.237493:0:17148:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b7603413800: total 0 00000100:00080000:0.0:1790779267.237498:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9b7603412000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790779267.237531:0:17148:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1790779267.237727:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e04fb1a-50ac-430a-9a7f-cdeca654586e+15:2397:x1877767642824192:12345-192.168.203.3@tcp:39:umount.0 Request processed in 298us (511us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1790779267.237736:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 67 00000020:00010000:3.0:1790779267.238310:0:17134:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b7603413800: total 0 00010000:00010000:3.0:1790779267.238316:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779267.238367:0:17134:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b7603413800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1790779267.238399:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:3.0:1790779267.238403:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790779267.238410:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670400/0xb1aa4014e936e3ab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cc7 expref: 14 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779267.238428:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:3.0:1790779267.238431:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790779267.238435:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670200/0xb1aa4014e936e492 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d14 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779267.238448:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603616a00) 00010000:00010000:3.0:1790779267.238450:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779267.238454:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034ae200/0xb1aa4014e936e269 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c65 expref: 12 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779267.238492:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b7712a97b00) 00010000:00010000:3.0:1790779267.238495:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790779267.238499:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602671a00/0xb1aa4014e936e437 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cf1 expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779267.238513:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7707e69900) 00010000:00010000:3.0:1790779267.238516:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779267.238520:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663a00/0xb1aa4014e936e2a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c73 expref: 10 pid: 19938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779267.238533:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b7707e69500) 00010000:00010000:3.0:1790779267.238536:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790779267.238539:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76034af200/0xb1aa4014e936e32d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c9d expref: 9 pid: 17148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779267.238553:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b771d81a600) 00010000:00010000:3.0:1790779267.238555:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790779267.238558:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7600/0xb1aa4014e936e3dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425cdc expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779267.238572:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b7712a97a00) 00010000:00010000:3.0:1790779267.238574:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779267.238578:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7602670e00/0xb1aa4014e936e24d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c5e expref: 7 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779267.238590:0:17134:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b7603413800, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1790779267.238605:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779267.238611:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779267.238613:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779267.252214:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779267.252400:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642824320 00000100:00100000:1.0:1790779267.252411:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642824320 00000100:00100000:1.0:1790779267.252481:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 68 00000100:00100000:1.0:1790779267.252490:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+5:2397:x1877767642824320:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:1.0:1790779267.252523:0:17146:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e189 00000100:00080000:1.0:1790779267.252540:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9b7603410800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790779267.252607:0:17146:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1790779267.252919:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779267.253187:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e04fb1a-50ac-430a-9a7f-cdeca654586e+3:2397:x1877767642824320:12345-192.168.203.3@tcp:39:umount.0 Request processed in 696us (980us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790779267.253197:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 68 00010000:00010000:3.0:1790779267.254568:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779267.625924:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779267.688359:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663867392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779267.688601:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779267.689758:0:18656:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663867392 00000100:00100000:3.0:1790779267.689847:0:18656:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663867392 00000100:00100000:3.0:1790779267.689988:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790779267.690006:0:18656:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663867392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790779267.690031:0:18656:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00080000:0.0:1790779267.690200:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779267.691766:0:18656:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663867392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1764us (3167us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779267.692037:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663867392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779267.692125:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790779268.200486:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779268.200529:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663867520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779268.200684:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779268.202034:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663867520 00000100:00100000:1.0:1790779268.202070:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663867520 00000100:00100000:1.0:1790779268.202175:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790779268.202234:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663867520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779268.202303:0:17152:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1790779268.202441:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663867520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 228us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779268.202463:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790779268.205177:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663867520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779268.205997:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790779268.213188:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663867648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779268.213267:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779268.216426:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663867648 00000100:00100000:2.0:1790779268.216456:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663867648 00000100:00100000:2.0:1790779268.216578:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790779268.216591:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663867648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790779268.216633:0:17151:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790779268.216790:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663867648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 201us (3522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779268.216798:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790779268.216923:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663867648:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1790779268.264966:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790779268.648199:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779268.712205:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779268.712238:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663867776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779268.712311:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779268.712488:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663867776 00000100:00100000:2.0:1790779268.712498:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663867776 00000100:00100000:0.0:1790779268.712535:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663868032:0@lo:400:kworker.0 00000100:00100000:2.0:1790779268.712563:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790779268.712577:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779268.712578:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663867776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779268.712615:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663868544:0@lo:400:kworker.0 00002000:00000024:2.0:1790779268.712621:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779268.712644:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779268.712674:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663867776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779268.712678:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663869056:0@lo:400:kworker.0 00000100:00100000:2.0:1790779268.712686:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790779268.712706:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779268.712714:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663868032 00000100:00100000:2.0:1790779268.712719:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663868032 00000100:00100000:0.0:1790779268.712729:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790779268.712736:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663867904:0@lo:400:kworker.0 00000100:00100000:2.0:1790779268.712760:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790779268.712770:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663868032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.712771:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779268.712816:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663868416:0@lo:400:kworker.0 00000100:00100000:2.0:1790779268.712828:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663868032:12345-0@lo:400:kworker.0 Request processed in 60us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779268.712843:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779268.712858:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663868928:0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.712907:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779268.712939:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663868032:0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.712968:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663868544 00000100:00100000:2.0:1790779268.712972:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790779268.712973:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663868544 00000100:00100000:2.0:1790779268.712990:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663868416 00000100:00100000:2.0:1790779268.712995:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663868416 00000100:00100000:0.0:1790779268.713008:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663869056 00000100:00100000:0.0:1790779268.713013:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663869056 00000100:00100000:0.0:1790779268.713036:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663868928 00000100:00100000:0.0:1790779268.713039:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663868928 00000100:00100000:0.0:1790779268.713052:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790779268.713058:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663868544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713094:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663868544:12345-0@lo:400:kworker.0 Request processed in 36us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779268.713103:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790779268.713130:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790779268.713136:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663869056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713166:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1877767663869056:12345-0@lo:400:kworker.0 Request processed in 30us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779268.713171:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790779268.713182:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790779268.713188:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663868928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713212:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1877767663868928:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779268.713218:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790779268.713243:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1877767663868928:0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713252:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663868544:0@lo:400:kworker.0 00010000:00080000:0.0:1790779268.713263:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7f6300 x1877767663869056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779268.713273:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663869056:0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713301:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663868160:0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713324:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779268.713341:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663868672:0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713360:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779268.713384:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663867776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779268.713396:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790779268.713400:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663868288:0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713422:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779268.713441:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663868800:0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713460:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779268.713476:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663868160 00000100:00100000:0.0:1790779268.713479:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663868160 00000100:00100000:0.0:1790779268.713496:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663868672 00000100:00100000:0.0:1790779268.713499:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663868672 00000100:00100000:0.0:1790779268.713511:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663868800 00000100:00100000:0.0:1790779268.713514:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663868800 00000100:00100000:0.0:1790779268.713527:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790779268.713532:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663868160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713563:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663868160:12345-0@lo:400:kworker.0 Request processed in 31us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779268.713569:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790779268.713579:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663868288 00000100:00100000:2.0:1790779268.713585:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663868288 00000100:00100000:0.0:1790779268.713585:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790779268.713607:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663868672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713634:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663868672:12345-0@lo:400:kworker.0 Request processed in 29us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779268.713640:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790779268.713650:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790779268.713656:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663868800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713692:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663868800:12345-0@lo:400:kworker.0 Request processed in 36us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779268.713698:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:0.0:1790779268.713721:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b7f7800 x1877767663868800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779268.713730:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663868800:0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713751:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663868160:0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713759:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663868672:0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713816:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790779268.713824:0:18654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663868416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713864:0:18654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663868416:12345-0@lo:400:kworker.0 Request processed in 41us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779268.713869:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1790779268.713907:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779268.713911:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790779268.713913:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790779268.713916:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779268.713940:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663868416:0@lo:400:kworker.0 00000100:00100000:2.0:1790779268.713942:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790779268.713960:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663868288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779268.713976:0:17141:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663867904 00000100:00100000:0.0:1790779268.713982:0:17141:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663867904 00000100:00100000:2.0:1790779268.714006:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663868288:12345-0@lo:400:kworker.0 Request processed in 48us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779268.714013:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790779268.714016:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790779268.714024:0:17141:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3650:x1877767663867904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779268.714059:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663868288:0@lo:400:kworker.0 00000100:00100000:1.0:1790779268.714150:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779268.714160:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663869184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790779268.715092:0:17141:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3650:x1877767663867904:12345-0@lo:400:kworker.0 Request processed in 1068us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779268.715101:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790779268.715702:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663867904:0@lo:400:kworker.0 00000100:00100000:1.0:1790779268.718023:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779268.718232:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663869184 00000100:00100000:2.0:1790779268.718241:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663869184 00000100:00100000:2.0:1790779268.718294:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790779268.718303:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663869184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790779268.718329:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790779268.718383:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663869184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779268.718390:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790779268.725284:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663869184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779269.207604:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779269.207649:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779269.207684:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642824448 00000100:00100000:2.0:1790779269.207694:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642824448 00000100:00100000:2.0:1790779269.207758:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642824576 00000100:00100000:2.0:1790779269.207761:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642824576 00000100:00100000:2.0:1790779269.207807:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1790779269.207818:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+11:2399:x1877767642824448:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779269.207835:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790779269.207852:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00010000:00010000:2.0:1790779269.207859:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e1ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425be0 expref: 11 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779269.207918:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+10:2398:x1877767642824576:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779269.207926:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779269.207931:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779269.207944:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3200/0xb1aa4014e936e1f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c50 expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779269.207955:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779269.207989:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+9:2399:x1877767642824448:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 172us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779269.208000:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+9:2398:x1877767642824576:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 137us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779269.208011:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1790779269.210317:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:0.0:1790779269.213685:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779269.214560:0:20633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642824704 00000100:00100000:1.0:1790779269.214574:0:20633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642824704 00000100:00100000:1.0:1790779269.215486:0:20633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:1.0:1790779269.215502:0:20633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+8:2399:x1877767642824704:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779269.215520:0:20633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779269.215542:0:20633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3e00/0xb1aa4014e936e1b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c11 expref: 8 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779269.215558:0:20633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779269.215614:0:20633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+7:2399:x1877767642824704:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 118us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779269.222029:0:20633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:0.0:1790779269.227694:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779269.227791:0:17148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642824960 00000100:00100000:2.0:1790779269.227811:0:17148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642824960 00000100:00100000:2.0:1790779269.227924:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00100000:2.0:1790779269.227934:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cb4944-c4c7-43b5-9787-d954585b459c+6:2397:x1877767642824960:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:2.0:1790779269.227977:0:17148:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e1c1 00000020:00010000:2.0:1790779269.227985:0:17148:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b773c020800: total 0 00000100:00080000:2.0:1790779269.227989:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9b773c025800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790779269.228009:0:17148:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1790779269.228153:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10cb4944-c4c7-43b5-9787-d954585b459c+5:2397:x1877767642824960:12345-192.168.203.3@tcp:39:umount.0 Request processed in 220us (467us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1790779269.228161:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 69 00000100:00080000:0.0:1790779269.228379:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1790779269.228444:0:20173:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b773c020800: total 0 00010000:00010000:3.0:1790779269.228626:0:20173:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b773c020800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790779269.228658:0:20173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7707e69900) 00010000:00010000:3.0:1790779269.228662:0:20173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790779269.228669:0:20173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3a00/0xb1aa4014e936e2b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425c7a expref: 4 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779269.228692:0:20173:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b773c020800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1790779269.228702:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779269.228704:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779269.228706:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779269.239108:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779269.239229:0:17147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642825088 00000100:00100000:3.0:1790779269.239239:0:17147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642825088 00000100:00100000:3.0:1790779269.239326:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00100000:3.0:1790779269.239354:0:17147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+5:2397:x1877767642825088:12345-192.168.203.3@tcp:39:umount.0 00000020:00000080:3.0:1790779269.239393:0:17147:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e1c8 00000100:00080000:3.0:1790779269.239405:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9b773c026000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790779269.239434:0:17147:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:2.0:1790779269.239451:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779269.239589:0:17147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10cb4944-c4c7-43b5-9787-d954585b459c+3:2397:x1877767642825088:12345-192.168.203.3@tcp:39:umount.0 Request processed in 254us (489us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790779269.239607:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 70 00000100:00080000:0.0:1790779269.240508:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779269.301208:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779269.302354:0:17138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642825344 00000100:00100000:0.0:1790779269.302367:0:17138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642825344 00000100:00100000:0.0:1790779269.302623:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 173 00000100:00100000:0.0:1790779269.302635:0:17138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773cbd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+7:2397:x1877767642825344:12345-192.168.203.3@tcp:251:umount.0 00000020:00000080:0.0:1790779269.302684:0:17138:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e15f 00000020:00010000:0.0:1790779269.302692:0:17138:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b76024c3800: total 0 00000100:00080000:0.0:1790779269.302697:0:17138:0:(import.c:65:import_set_state_nolock()) ffff9b760342c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790779269.302834:0:17138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773cbd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b53cdbc3-122f-46dd-b58e-9b4de37f59c6+3:2397:x1877767642825344:12345-192.168.203.3@tcp:251:umount.0 Request processed in 201us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779269.302842:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 173 00000020:00010000:3.0:1790779269.306174:0:17134:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b76024c3800: total 0 00010000:00010000:2.0:1790779269.311005:0:17134:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b76024c3800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790779269.311216:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701663200/0xb1aa4014e936e166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425b69 expref: 2 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779269.311239:0:17134:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b76024c3800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1790779269.311253:0:17134:0:(genops.c:885:class_export_put()) final put ffff9b76024c3800/b53cdbc3-122f-46dd-b58e-9b4de37f59c6 00010000:00010000:2.0:1790779269.311278:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779269.311281:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779269.311284:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790779269.311559:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b76024c3800/b53cdbc3-122f-46dd-b58e-9b4de37f59c6 for MGS 00000020:00000080:3.0:1790779269.311606:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b760342c800 for MGS 00010000:00010000:1.0:1790779269.678190:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779270.696010:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790779271.333998:0:20720:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790779271.358827:0:20720:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1790779271.358928:0:20720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.358942:0:20720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.358950:0:20720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.358958:0:20720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.358981:0:20720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790779271.358987:0:20720:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790779271.359016:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790779271.359021:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790779271.359027:0:20720:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790779271.359052:0:20720:0:(import.c:65:import_set_state_nolock()) ffff9b77344a5000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1790779271.363706:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779271.363737:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.363761:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768a00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779271.363766:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.363777:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779271.363794:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779271.363799:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790779271.363803:0:17134:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790779271.363806:0:17134:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790779271.363849:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.363856:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779271.363922:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.363930:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718768a00/0xb1aa4014e936dd22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dd29 expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.363945:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779271.363947:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779271.363948:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779271.364103:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779271.364125:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663869440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779271.364198:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779271.364389:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663869440 00000100:00100000:3.0:1790779271.364398:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663869440 00000100:00100000:3.0:1790779271.364469:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779271.364479:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3651:x1877767663869440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779271.364492:0:17133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779271.364507:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769400/0xb1aa4014e936dd29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936dd22 expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.364519:0:17133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779271.364645:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f89954ec-b1b4-4b66-a198-81b81a38f825+23:3651:x1877767663869440:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779271.364654:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790779271.366121:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663869440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779271.367033:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663869312:0@lo:39:umount.0 00000100:00100000:0.0:1790779271.367096:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779271.370731:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663869312 00000100:00100000:3.0:1790779271.370831:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663869312 00000100:00100000:2.0:1790779271.371924:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790779271.371944:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877767663869312:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790779271.371979:0:17148:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dd53 00000100:00080000:2.0:1790779271.371990:0:17148:0:(import.c:65:import_set_state_nolock()) ffff9b760390a000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790779271.372110:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3648:x1877767663869312:12345-0@lo:39:umount.0 Request processed in 175us (5013us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779271.372118:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1790779271.372132:0:17148:0:(genops.c:885:class_export_put()) final put ffff9b77344a3800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1790779271.372187:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77344a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1790779271.372962:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790779271.372974:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77344a3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790779271.373033:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b760390a000 for lustre-MDT0000 00000100:00100000:2.0:1790779271.378041:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663869312:0@lo:39:umount.0 00000100:00080000:0.0:1790779271.381134:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790779271.381142:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790779271.381149:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790779271.382308:0:20720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.382323:0:20720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.382331:0:20720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.382339:0:20720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.382367:0:20720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790779271.382374:0:20720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.382381:0:20720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.382387:0:20720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.382394:0:20720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.382476:0:20720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790779271.382485:0:20720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.382492:0:20720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.382498:0:20720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.382505:0:20720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.382692:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790779271.382700:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.382708:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779271.382712:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.382720:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779271.382728:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779271.382733:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790779271.382736:0:17134:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1790779271.382791:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.382810:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790779271.382897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663869568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779271.382965:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790779271.383310:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.383318:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76039a2000/0xb1aa4014e936dc73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dc7a expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.383331:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779271.383335:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.383341:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769c00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779271.383344:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.383351:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779271.383359:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779271.383364:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1790779271.383366:0:17134:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1790779271.383369:0:17134:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790779271.383385:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.383393:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790779271.384468:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779271.384482:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663869696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779271.384546:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779271.384595:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663869568 00000100:00100000:1.0:1790779271.384602:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663869568 00000100:00100000:1.0:1790779271.384641:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663869696 00000100:00100000:1.0:1790779271.384643:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663869696 00000100:00100000:1.0:1790779271.384662:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790779271.384670:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+24:3649:x1877767663869568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779271.384683:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779271.384698:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768000/0xb1aa4014e936dc7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936dc73 expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779271.384725:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779271.384774:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+23:3649:x1877767663869568:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (1809us total) trans 0 rc 0/0 00010000:00010000:0.0:1790779271.385357:0:20720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790779271.385567:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790779271.385603:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790779271.385614:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7742058050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+22:3649:x1877767663869696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779271.385634:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779271.385645:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662c00/0xb1aa4014e936e086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936e07f expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779271.385656:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779271.385705:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7742058050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3649:x1877767663869696:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779271.385711:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790779271.385860:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663869696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779271.385871:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:3649:1877767663869568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779271.385991:0:20173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779271.385998:0:20173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779271.386836:0:20173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769800 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779271.386842:0:20173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779271.386852:0:20173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779271.386993:0:20173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779271.386999:0:20173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790779271.387002:0:20173:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790779271.387085:0:20173:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790779271.387120:0:20173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779271.387127:0:20173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790779271.387211:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663869824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779271.387271:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790779271.389150:0:20173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779271.389166:0:20173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718769800/0xb1aa4014e936e22a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e231 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779271.389190:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779271.389192:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779271.389196:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779271.389218:0:17131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663869824 00000100:00100000:1.0:1790779271.389229:0:17131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663869824 00000100:00100000:1.0:1790779271.389293:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790779271.389302:0:17131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+21:3651:x1877767663869824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779271.389316:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779271.389334:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3600/0xb1aa4014e936e231 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936e22a expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779271.389345:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779271.389411:0:17131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f89954ec-b1b4-4b66-a198-81b81a38f825+20:3651:x1877767663869824:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779271.389432:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1790779271.390125:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779271.390154:0:20720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779271.390165:0:20720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779271.390172:0:20720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779271.390179:0:20720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779271.390201:0:20720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790779271.390218:0:20720:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1790779271.390223:0:20720:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1790779271.390299:0:20720:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1790779271.390313:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1790779271.390317:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779271.390322:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1790779271.390328:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9b760342c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790779271.390333:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9b77041d5800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790779271.390337:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9b7711bf7800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790779271.390341:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9b774129d800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790779271.390349:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9b773c020800 10cb4944-c4c7-43b5-9787-d954585b459c 192.168.203.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1790779271.390353:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9b7603413800 0e04fb1a-50ac-430a-9a7f-cdeca654586e 192.168.203.3@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1790779271.390357:0:20720:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9b77041cb380) has exports, disconnecting them 00000020:00080000:2.0:1790779271.390361:0:20720:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b760342c000), last request at 1790779268 00000020:00000080:2.0:1790779271.390368:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e04e 00000100:00080000:2.0:1790779271.390387:0:20720:0:(import.c:65:import_set_state_nolock()) ffff9b7603428800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790779271.390431:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779271.390437:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779271.390444:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2c00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779271.390448:0:17135:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779271.390456:0:17135:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779271.390462:0:17135:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779271.390478:0:17135:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1790779271.390480:0:17135:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790779271.390482:0:17135:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1790779271.390515:0:17135:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779271.390521:0:17135:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779271.390535:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779271.390541:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76039a2c00/0xb1aa4014e936dc65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dc6c expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779271.390551:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779271.390552:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779271.390554:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1790779271.390570:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b760342c000): rc 0 00000020:00000080:2.0:1790779271.390573:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b760342c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1790779271.390591:0:20720:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b77041d5800), last request at 1790779268 00000020:00000080:2.0:1790779271.390595:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936def0 00000100:00080000:2.0:1790779271.390600:0:20720:0:(import.c:65:import_set_state_nolock()) ffff9b77041d3000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790779271.390611:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1790779271.390618:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b77041d5800): rc 0 00000020:00000080:2.0:1790779271.390620:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b77041d5800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1790779271.390623:0:20720:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b7711bf7800), last request at 1790779196 00000020:00000080:2.0:1790779271.390626:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936de41 00000100:00080000:2.0:1790779271.390630:0:20720:0:(import.c:65:import_set_state_nolock()) ffff9b7711bf2000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790779271.390638:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1790779271.390644:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b7711bf7800): rc 0 00000020:00000080:2.0:1790779271.390651:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7711bf7800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1790779271.390656:0:20720:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b774129d800), last request at 1790779196 00000020:00000080:2.0:1790779271.390659:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dde6 00000100:00080000:2.0:1790779271.390663:0:20720:0:(import.c:65:import_set_state_nolock()) ffff9b774129d000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790779271.390674:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1790779271.390681:0:20720:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:2.0:1790779271.390816:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b774129d800): rc 0 00000004:00000080:2.0:1790779271.390822:0:20720:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc92c1747ae0 00000100:00080000:2.0:1790779271.390840:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790779271.390844:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1790779271.391971:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790779271.392777:0:20720:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1790779271.392815:0:20720:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790779271.393037:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663870080:0@lo:39:umount.0 00000100:00100000:0.0:1790779271.394562:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663869824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779271.394595:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779271.394605:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663869952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779271.394662:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779271.394744:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663869952 00000100:00100000:0.0:1790779271.394752:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663869952 00000100:00100000:0.0:1790779271.394823:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790779271.394832:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+20:3651:x1877767663869952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790779271.394849:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779271.394869:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3c00/0xb1aa4014e936dc6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936dc65 expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779271.395039:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779271.395078:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f89954ec-b1b4-4b66-a198-81b81a38f825+19:3651:x1877767663869952:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779271.395086:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790779271.395142:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:3651:1877767663869952:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779271.396156:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779271.396187:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718769c00/0xb1aa4014e936e07f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e086 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1790779271.396215:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760342c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790779271.396280:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77041d5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790779271.396306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7711bf7800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790779271.396328:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7603428800 for lustre-MDT0000 00000020:00000080:3.0:1790779271.396332:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b77041d3000 for lustre-MDT0000 00000020:00000080:3.0:1790779271.396336:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7711bf2000 for lustre-MDT0000 00010000:00010000:3.0:1790779271.396426:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779271.396429:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779271.396431:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790779271.397135:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790779271.397141:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1790779271.397162:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790779271.397220:0:20720:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790779271.397246:0:20720:0:(import.c:65:import_set_state_nolock()) ffff9b773b543800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1790779271.397257:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790779271.397259:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1790779271.397305:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790779271.397364:0:20720:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790779271.397373:0:20720:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1790779271.397414:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9b77041cb380) has no exports 00000100:00100000:1.0:1790779271.398508:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779271.398621:0:18106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663870080 00000100:00100000:0.0:1790779271.398631:0:18106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663870080 00000100:00100000:0.0:1790779271.398685:0:18106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790779271.398695:0:18106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1877767663870080:12345-0@lo:39:umount.0 00000020:00000080:0.0:1790779271.398730:0:18106:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936de6b 00000100:00080000:0.0:1790779271.398740:0:18106:0:(import.c:65:import_set_state_nolock()) ffff9b7603b13800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790779271.398774:0:18106:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1790779271.398994:0:18106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3648:x1877767663870080:12345-0@lo:39:umount.0 Request processed in 300us (491us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790779271.399001:0:18106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1790779271.399045:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704183800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790779271.399052:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663870080:0@lo:39:umount.0 00000100:00100000:0.0:1790779271.399066:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663870208:0@lo:9:umount.0 00000100:00100000:0.0:1790779271.399101:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779271.399120:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663870336:0@lo:9:umount.0 00000100:00100000:0.0:1790779271.399138:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779271.403093:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663870208 00000100:00100000:3.0:1790779271.403108:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663870208 00000100:00100000:3.0:1790779271.403173:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663870336 00000100:00100000:3.0:1790779271.403176:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663870336 00000100:00100000:3.0:1790779271.403201:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790779271.403217:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877767663870208:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790779271.403246:0:18653:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936df36 00000100:00080000:3.0:1790779271.403255:0:18653:0:(import.c:65:import_set_state_nolock()) ffff9b773424d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790779271.403314:0:18653:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1790779271.403499:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3648:x1877767663870208:12345-0@lo:9:umount.0 Request processed in 290us (4396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779271.403506:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790779271.403521:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790779271.403529:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1877767663870336:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790779271.403541:0:18653:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e08d 00000100:00080000:3.0:1790779271.403561:0:18653:0:(import.c:65:import_set_state_nolock()) ffff9b7603429000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790779271.403582:0:18653:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1790779271.403662:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3648:x1877767663870336:12345-0@lo:9:umount.0 Request processed in 135us (4523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779271.403668:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1790779271.403711:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773b543800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790779271.403723:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790779271.403726:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779271.403729:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663870208:0@lo:9:umount.0 00000100:00080000:3.0:1790779271.403740:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704186000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790779271.403849:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790779271.403854:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790779271.404048:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790779271.404112:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790779271.404116:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779271.404120:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663870336:0@lo:9:umount.0 00010000:00010000:3.0:1790779271.404160:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779271.404165:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1790779271.421225:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9b77041cb380) has no exports 00000020:00000080:2.0:1790779271.513271:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dcc0 00000020:00000080:2.0:1790779271.513286:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b77342fc800/lustre-QMT0000_UUID 00000020:01000000:2.0:1790779271.513372:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1790779271.513505:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779271.513516:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790779271.513521:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9b773b780000) has no exports 00000020:00000080:3.0:1790779271.513931:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dcb9 00000020:00000080:3.0:1790779271.513938:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b773428c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790779271.517625:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77342fc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1790779271.518920:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773428c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790779271.519078:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779271.519090:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790779271.519095:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b773428e800/lustre-QMT0000_UUID 00000020:00000080:3.0:1790779271.519098:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773428e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1790779271.519108:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1790779271.720072:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779272.744214:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779272.812284:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663870464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779272.812368:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779272.812428:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663870464 00000100:00100000:0.0:1790779272.812438:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663870464 00000001:00100000:3.0:1790779272.812454:0:17126:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790779272.812460:0:17126:0:(genops.c:885:class_export_put()) final put ffff9b774129d800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1790779272.812475:0:17126:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10cb4944-c4c7-43b5-9787-d954585b459c 00000001:00080000:3.0:1790779272.812482:0:17126:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1790779272.812491:0:17126:0:(genops.c:885:class_export_put()) final put ffff9b773c020800/10cb4944-c4c7-43b5-9787-d954585b459c 00000001:00100000:3.0:1790779272.812500:0:17126:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000100:00100000:0.0:1790779272.812502:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000001:00080000:3.0:1790779272.812505:0:17126:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000100:00100000:0.0:1790779272.812510:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663870464:12345-0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1790779272.812511:0:17126:0:(genops.c:885:class_export_put()) final put ffff9b7603413800/0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000020:00000080:3.0:1790779272.812525:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b774129d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00002000:00000024:0.0:1790779272.812543:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000020:00000080:3.0:1790779272.812570:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773c020800/10cb4944-c4c7-43b5-9787-d954585b459c for lustre-MDT0000 00000100:00100000:0.0:1790779272.812587:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663870464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779272.812595:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00000080:3.0:1790779272.812596:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603413800/0e04fb1a-50ac-430a-9a7f-cdeca654586e for lustre-MDT0000 00000100:00080000:0.0:1790779272.812618:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1790779272.812620:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b774129d000 for lustre-MDT0000 00000020:00000080:3.0:1790779272.812624:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773c025800 for lustre-MDT0000 00000020:00000080:3.0:1790779272.812628:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7603412000 for lustre-MDT0000 00000100:00100000:0.0:1790779272.812650:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663870464:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1790779272.812778:0:17879:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1790779272.812786:0:17879:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1790779272.812789:0:17879:0:(genops.c:885:class_export_put()) final put ffff9b77340a1800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1790779272.812802:0:17879:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 10cb4944-c4c7-43b5-9787-d954585b459c 00000001:00080000:1.0:1790779272.812807:0:17879:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1790779272.812809:0:17879:0:(genops.c:885:class_export_put()) final put ffff9b773c027000/10cb4944-c4c7-43b5-9787-d954585b459c 00000001:00100000:1.0:1790779272.812814:0:17879:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000001:00080000:1.0:1790779272.812822:0:17879:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1790779272.812823:0:17879:0:(genops.c:885:class_export_put()) final put ffff9b7603412800/0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000020:00000080:3.0:1790779272.812868:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77340a1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1790779272.812931:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773c027000/10cb4944-c4c7-43b5-9787-d954585b459c for lustre-MDT0001 00000020:00000080:3.0:1790779272.812963:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603412800/0e04fb1a-50ac-430a-9a7f-cdeca654586e for lustre-MDT0001 00000020:00000080:3.0:1790779272.812980:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7603b13800 for lustre-MDT0001 00000020:00000080:3.0:1790779272.812984:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773c026000 for lustre-MDT0001 00000020:00000080:3.0:1790779272.812987:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7603410800 for lustre-MDT0001 00000001:00100000:2.0:1790779272.819412:0:18648:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790779272.819423:0:18648:0:(genops.c:885:class_export_put()) final put ffff9b773424f000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1790779272.819469:0:18648:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000020:00000080:2.0:1790779272.819472:0:18648:0:(genops.c:885:class_export_put()) final put ffff9b77208af800/0e04fb1a-50ac-430a-9a7f-cdeca654586e 00000020:00000080:1.0:1790779272.819551:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773424f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790779272.819611:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77208af800/0e04fb1a-50ac-430a-9a7f-cdeca654586e for lustre-OST0000 00000020:00000080:1.0:1790779272.819632:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773424d000 for lustre-OST0000 00000020:00000080:1.0:1790779272.819637:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b772012e000 for lustre-OST0000 00000100:00100000:1.0:1790779273.320348:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663870592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779273.320423:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779273.320671:0:17151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663870592 00000100:00100000:2.0:1790779273.320679:0:17151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663870592 00000100:00100000:2.0:1790779273.320728:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790779273.320747:0:17151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1877767663870592:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1790779273.320756:0:17151:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790779273.320812:0:17151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1877767663870592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (388us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790779273.320818:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:02020000:2.0:1790779273.320856:0:3650:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1790779273.332851:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790779273.332858:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9b771828f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790779273.332863:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790779273.365336:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9b771828f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779273.365350:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1790779273.365366:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b771828f800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779273.365409:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7735c16d80 x1877767663870720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779273.365714:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663870720:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1790779273.365809:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779273.382801:0:17152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663870720 00000100:00100000:2.0:1790779273.382819:0:17152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663870720 00000100:00100000:2.0:1790779273.382904:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790779273.382913:0:17152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663870720:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1790779273.382932:0:17152:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790779273.392785:0:17152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663870720:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 9854us (26958us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790779273.392814:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1790779273.393210:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b771828f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779273.393224:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790779273.393228:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663870720:0@lo:38:ptlrpcd_00_01.0 00000020:01000000:3.0:1790779273.576237:0:20720:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b7735bf58a0 - data ffff9b770e009948/ffff9b7603170800 00000020:01000000:3.0:1790779273.576413:0:20720:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b760339b300 - data ffff9b770e1d6000/ffff9b7736faf400 00000001:00000004:3.0:1790779273.586040:0:20720:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:1.0:1790779273.662194:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790779273.662203:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790779273.662218:0:20720:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9b7735c15180 x1877767663870080/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790779281 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779273.662244:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1790779273.663241:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790779273.663245:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1790779273.663256:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790779273.663259:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790779273.668172:0:17170:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790779273.668179:0:17170:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1790779273.668191:0:17170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1790779273.673601:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790779273.673609:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1790779273.673670:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790779273.673673:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790779273.674651:0:17172:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790779273.674657:0:17172:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:3.0:1790779273.674669:0:17172:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1790779273.685381:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dc88 00000020:00000080:2.0:1790779273.685395:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7704184000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790779273.686470:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704184000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790779273.690007:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dc9d 00000020:00000080:2.0:1790779273.690020:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7704180000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790779273.690035:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1790779273.690042:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779273.690051:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790779273.690056:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9b77041c8000) has no exports 00000004:01000000:2.0:1790779273.690212:0:20720:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1790779273.690221:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dcff 00000020:00000080:2.0:1790779273.690224:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b760390b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790779273.690228:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790779273.690232:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779273.690236:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790779273.690238:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9b773b783380) has no exports 00000020:00000080:2.0:1790779273.690243:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dcf8 00000020:00000080:2.0:1790779273.690246:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7603908800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790779273.690401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704180000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1790779273.690410:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760390b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1790779273.690428:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603908800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1790779273.693462:0:20720:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790779273.693470:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790779273.693474:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1790779273.693483:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790779273.693486:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790779273.693655:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779273.693665:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790779273.693673:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dcea 00000020:00000080:2.0:1790779273.693682:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b760390e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790779273.694620:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7704186000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1790779273.694631:0:36:0:(genops.c:885:class_export_put()) final put ffff9b760390e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790779273.694635:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760390e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1790779273.694641:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790779273.699386:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790779273.699401:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779273.699413:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790779273.699418:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9b77340fcd40) has no exports 00000020:00000080:2.0:1790779273.699441:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dce3 00000020:00000080:2.0:1790779273.699450:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b773b541800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790779273.699907:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760390e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1790779273.699922:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b541800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1790779273.700652:0:20720:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790779273.700659:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790779273.700663:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1790779273.700670:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790779273.700672:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790779273.700726:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779273.700814:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1790779273.700830:0:20720:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1790779273.700838:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dcd5 00000020:00000080:2.0:1790779273.700846:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7711c96000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790779273.700851:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1790779273.700858:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779273.700862:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790779273.700865:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff9b77041c99c0) has no exports 00000020:00000080:2.0:1790779273.700871:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dcce 00000020:00000080:2.0:1790779273.700874:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7704185000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790779273.704041:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773b543800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1790779273.704056:0:36:0:(genops.c:885:class_export_put()) final put ffff9b7711c96800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790779273.704059:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7711c96800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1790779273.704067:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790779273.704154:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7711c96000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1790779273.704159:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704185000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1790779273.704190:0:20720:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1790779273.704194:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790779273.704198:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790779273.704205:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790779273.704259:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779273.704276:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790779273.704305:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779273.704308:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790779273.704311:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7711c92800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790779273.704314:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7711c92800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790779273.704319:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790779273.704375:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dca4 00000020:00000080:3.0:1790779273.704383:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7704181000/lustre-MDD0000_UUID 00000020:01000000:3.0:1790779273.704388:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1790779273.704392:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779273.704409:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790779273.704413:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9b77041ccd40) has no exports 00000020:00000080:3.0:1790779273.704436:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779273.704439:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1790779273.704447:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dcab 00000020:00000080:3.0:1790779273.704451:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7704185800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1790779273.704460:0:20720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b7604541000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1790779273.704464:0:20720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b7604541000 3 00000020:01000004:3.0:1790779273.704467:0:20720:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b7604541000 from lustre-MDT0000 00000020:00000080:3.0:1790779273.704486:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779273.704490:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1790779273.704493:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7704180800/lustre-MDT0000_UUID 00000020:00000080:3.0:1790779273.704495:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704180800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1790779273.704503:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1790779273.704554:0:20720:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1790779273.704558:0:20720:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1790779273.704561:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1790779273.704564:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779273.704567:0:20720:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790779273.704574:0:20720:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9b773f630800 f89954ec-b1b4-4b66-a198-81b81a38f825 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790779273.704579:0:20720:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9b76032219c0) has exports, disconnecting them 00000020:00080000:3.0:1790779273.704583:0:20720:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b773f630800), last request at 1790779180 00000020:00000080:3.0:1790779273.704598:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dc50 00000020:00010000:3.0:1790779273.704602:0:20720:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b773f630800: total 2 00000100:00080000:3.0:1790779273.704606:0:20720:0:(import.c:65:import_set_state_nolock()) ffff9b773f632800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790779273.704620:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b773f630800): rc 0 00000020:00080000:3.0:1790779273.704625:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9b76032219c0) has no exports 00000020:00010000:3.0:1790779273.704636:0:17134:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b773f630800: total 2 00010000:00010000:3.0:1790779273.704639:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779273.704662:0:17134:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b773f630800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1790779273.704691:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769000/0xb1aa4014e936e207 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936e200 expref: 14 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704722:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769200/0xb1aa4014e936de2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936de25 expref: 13 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704745:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2e00/0xb1aa4014e936dd7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936dd76 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704760:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2800/0xb1aa4014e936e215 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936e20e expref: 11 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704780:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3000/0xb1aa4014e936dd8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936dd84 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704792:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768200/0xb1aa4014e936e039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936e032 expref: 9 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704801:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a3800/0xb1aa4014e936dc5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936dc57 expref: 8 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704811:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662800/0xb1aa4014e936e078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936e071 expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704823:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7603be7c00/0xb1aa4014e936dedb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936ded4 expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704834:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718768c00/0xb1aa4014e936e223 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936e21c expref: 5 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704844:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894aa00/0xb1aa4014e936e00f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936e008 expref: 4 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704867:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7701662a00/0xb1aa4014e936deb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936deaa expref: 3 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704908:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76039a2600/0xb1aa4014e936dd6f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1aa4014e936dd68 expref: 2 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779273.704919:0:17134:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b773f630800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1790779273.704935:0:17134:0:(genops.c:885:class_export_put()) final put ffff9b773f630800/f89954ec-b1b4-4b66-a198-81b81a38f825 00010000:00010000:3.0:1790779273.704940:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779273.704942:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779273.704943:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779273.705027:0:17140:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b77157db000:17140] 1 exiting: rc = 0 00000020:00000080:1.0:1790779273.705355:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7704183800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790779273.705363:0:36:0:(genops.c:885:class_export_put()) final put ffff9b7704181800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790779273.705366:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704181800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1790779273.705375:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790779273.705431:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704181000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1790779273.705435:0:36:0:(genops.c:885:class_export_put()) final put ffff9b7704182800/lustre-MDD0000_UUID 00000020:00000080:1.0:1790779273.705437:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704182800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790779273.705441:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1790779273.705473:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7704185800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790779273.705478:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773f630800/f89954ec-b1b4-4b66-a198-81b81a38f825 for MGS 00000020:00000080:1.0:1790779273.705511:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773f632800 for MGS 00000100:00100000:1.0:1790779273.705569:0:17141:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b7735fcde00:17141] 2 exiting: rc = 0 00000100:00100000:1.0:1790779273.705644:0:17138:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b760273aa00:17138] 0 exiting: rc = 1 00000100:00100000:3.0:1790779273.706402:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706410:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706417:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706422:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706429:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706434:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706439:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706444:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706449:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706455:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706460:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706466:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706471:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706476:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706481:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706486:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706490:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706496:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706500:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706515:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706521:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706594:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706600:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706605:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706610:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706615:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706621:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706626:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706632:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706638:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706643:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706649:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706654:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706659:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706665:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706670:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706674:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706679:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706685:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706690:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706696:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706701:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706707:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706712:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706718:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706724:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706729:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706858:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706864:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706870:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706875:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706933:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706940:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706945:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706959:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706965:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706971:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706976:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.706982:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.707344:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.707350:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.707356:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.707362:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779273.707368:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1790779273.718945:0:20720:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b77124513c0 - data ffff9b770e0a0e58/ffff9b7604846800 00000020:01000000:1.0:1790779273.719097:0:20720:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b76044f1ba0 - data ffff9b7602085000/ffff9b773b968c00 00000020:00000080:1.0:1790779273.720113:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dc34 00000020:00000080:1.0:1790779273.720126:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b760322c000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790779273.720188:0:20720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b7604541000 from MGS, refs=2 00000020:01000004:1.0:1790779273.720193:0:20720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b7604541000 2 00000020:01000004:1.0:1790779273.720197:0:20720:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b7604541000 from MGS 00000020:00000080:1.0:1790779273.720225:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779273.720233:0:20720:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1790779273.720236:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7603229000/MGS 00000020:00000080:1.0:1790779273.720239:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603229000/MGS for MGS 00000020:01000000:1.0:1790779273.720246:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1790779273.720336:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1790779273.720341:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779273.720346:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790779273.720353:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b77344a7800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790779273.720359:0:20720:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9b773059cd40) has exports, disconnecting them 00000020:00080000:1.0:1790779273.720364:0:20720:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b77344a7800), last request at 1790779180 00000020:00000080:1.0:1790779273.720368:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dd37 00000020:00080000:1.0:1790779273.720378:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b77344a7800): rc 0 00000020:00000080:1.0:1790779273.720382:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b77344a7800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790779273.725678:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760322c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790779273.728050:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77344a7800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790779273.824261:0:20720:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790779273.824272:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790779273.824276:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790779273.824284:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790779273.824453:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779273.824461:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790779273.824470:0:20720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b7604541000 1 00000020:00000080:1.0:1790779273.824476:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dc26 00000020:00000080:1.0:1790779273.824484:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b760322f800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790779273.824490:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790779273.824506:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779273.824510:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790779273.824514:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9b773b7819c0) has no exports 00010000:00010000:3.0:1790779273.825113:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790779273.825126:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b77344a5000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790779273.825134:0:9333:0:(genops.c:885:class_export_put()) final put ffff9b7711c97800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790779273.825137:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7711c97800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1790779273.825145:0:9333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1790779273.825227:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760322f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1790779273.834867:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663870976:0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.834977:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779273.835026:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663871488:0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.835051:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779273.835079:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790779273.835085:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f89954ec-b1b4-4b66-a198-81b81a38f825:3652:1877767663870848:0@lo:400:kworker.0 00000400:00000100:3.0:1790779273.835106:0:3652:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877767663870848 offset 0 length 224: 4 00000100:00100000:3.0:1790779273.835131:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1877767663871360:0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.835152:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779273.835179:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663871104:0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.835220:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779273.835238:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663871616:0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.835258:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779273.835276:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790779273.835282:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663871232:0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.835302:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779273.835321:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663871744:0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.835341:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779273.835370:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663870976 00000100:00100000:3.0:1790779273.835377:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663870976 00000100:00100000:3.0:1790779273.835423:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663871104 00000100:00100000:3.0:1790779273.835426:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663871104 00000100:00100000:3.0:1790779273.835452:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790779273.835461:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663870976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.835508:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663870976:12345-0@lo:400:kworker.0 Request processed in 48us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779273.835514:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790779273.835529:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790779273.835536:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663871104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.835567:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663871104:12345-0@lo:400:kworker.0 Request processed in 33us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779273.835574:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790779273.835591:0:20632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663871488 00000100:00100000:3.0:1790779273.835595:0:20632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663871488 00000100:00100000:3.0:1790779273.835614:0:20632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663871360 00000100:00100000:3.0:1790779273.835617:0:20632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663871360 00000100:00100000:3.0:1790779273.835624:0:20632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663871616 00000100:00100000:3.0:1790779273.835633:0:20632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663871616 00000100:00100000:3.0:1790779273.835643:0:20632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663871232 00000100:00100000:3.0:1790779273.835645:0:20632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663871232 00000100:00100000:3.0:1790779273.835651:0:20632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663871744 00000100:00100000:3.0:1790779273.835653:0:20632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663871744 00000100:00100000:3.0:1790779273.835670:0:20632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790779273.835677:0:20632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663871488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.835713:0:20632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663871488:12345-0@lo:400:kworker.0 Request processed in 37us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779273.835720:0:20632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790779273.835733:0:20632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790779273.835741:0:20632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663871744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.835785:0:20632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663871744:12345-0@lo:400:kworker.0 Request processed in 47us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779273.835791:0:20632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790779273.835804:0:20632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790779273.835808:0:20632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1877767663871360:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790779273.835815:0:20632:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790779273.835838:0:20632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3652:x1877767663871360:12345-0@lo:400:kworker.0 Request processed in 29us (686us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790779273.835844:0:20632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790779273.835855:0:20632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790779273.835858:0:20632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1877767663871616:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790779273.835862:0:20632:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790779273.835906:0:20632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1877767663871616:12345-0@lo:400:kworker.0 Request processed in 45us (646us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790779273.835912:0:20632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790779273.835923:0:20632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790779273.835935:0:20632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1877767663871232:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790779273.835940:0:20632:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790779273.835965:0:20632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1877767663871232:12345-0@lo:400:kworker.0 Request processed in 30us (662us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790779273.835971:0:20632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1790779273.836010:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779273.836015:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790779273.836040:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790779273.836045:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9b7603229800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790779273.836050:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790779273.836055:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9b7603229800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779273.836059:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:3.0:1790779273.836068:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b7603229800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779273.836090:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603832a00 x1877767663871872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779273.836112:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663871232:0@lo:400:kworker.0 00010000:00080000:3.0:1790779273.836125:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9b7603832d80 x1877767663871744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779273.836135:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663871744:0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.836145:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663871104:0@lo:400:kworker.0 00000100:00080000:3.0:1790779273.836153:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790779273.836156:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9b7720129800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790779273.836159:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790779273.836169:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9b7720129800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779273.836172:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 545 00000100:00080000:3.0:1790779273.836177:0:3649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b7720129800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779273.836189:0:3649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b772fe25500 x1877767663872000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779273.836199:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663871616:0@lo:400:kworker.0 00000100:00100000:3.0:1790779273.836226:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877767663871872:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1790779273.836251:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779273.836268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b772fe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663872000:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1790779273.836286:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779273.836312:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663871872 00000100:00100000:3.0:1790779273.836316:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663871872 00000100:00100000:3.0:1790779273.836335:0:17146:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663872000 00000100:00100000:3.0:1790779273.836337:0:17146:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663872000 00000100:00100000:3.0:1790779273.836350:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790779273.836354:0:17146:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663871872:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1790779273.836372:0:17146:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790779273.838210:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663872128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779273.838269:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779273.838944:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663872128 00000100:00100000:1.0:1790779273.838953:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663872128 00000100:00100000:1.0:1790779273.839002:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790779273.839010:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663872128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790779273.839038:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790779273.839088:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663872128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779273.839095:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790779273.839146:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663872128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790779273.848151:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790779273.848165:0:17148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663872000:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1790779273.848193:0:17148:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790779273.848286:0:17148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663872000:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 120us (11997us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790779273.848294:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1790779273.848353:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7720129800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779273.848359:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790779273.848363:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b772fe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663872000:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1790779273.848399:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790779273.848403:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9b773f4fe000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790779273.848419:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790779273.848424:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9b773f4fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779273.848428:0:3652:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1790779273.848439:0:3652:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b773f4fe000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779273.848480:0:3652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603746680 x1877767663872256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779273.848505:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1877767663871360:0@lo:400:kworker.0 00000100:00100000:1.0:1790779273.848527:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663870976:0@lo:400:kworker.0 00010000:00080000:1.0:1790779273.848540:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9b7603832300 x1877767663871488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779273.848549:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663871488:0@lo:400:kworker.0 00000100:00100000:1.0:1790779273.848573:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663872256:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1790779273.848611:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779273.848654:0:19938:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663872256 00000100:00100000:1.0:1790779273.848662:0:19938:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663872256 00000100:00100000:1.0:1790779273.848692:0:19938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790779273.848696:0:19938:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1877767663872256:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1790779273.848707:0:19938:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790779273.848740:0:19938:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1877767663872256:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 41us (128us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790779273.848746:0:19938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1790779273.848790:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773f4fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779273.848795:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790779273.848807:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663872256:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1790779273.853200:0:17146:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663871872:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 16836us (16939us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790779273.853215:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1790779273.853327:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7603229800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790779273.853333:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790779273.853336:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877767663871872:0@lo:38:ptlrpcd_00_00.0 00000020:00000080:3.0:1790779273.888587:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779273.888611:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1790779273.888617:0:20720:0:(genops.c:885:class_export_put()) final put ffff9b7604544000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790779273.888622:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7604544000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1790779273.888634:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1790779273.888848:0:20720:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b7604545000 00000020:02000400:3.0:1790779273.890977:0:20720:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1790779274.857392:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779275.895259:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779276.907326:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790779276.907974:0:19466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790779276.907980:0:19466:0:(genops.c:885:class_export_put()) final put ffff9b760342a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790779276.908071:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760342a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790779276.908120:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7603429000 for lustre-OST0001 00000100:00100000:0.0:1790779277.928469:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663872384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779277.928563:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779277.928666:0:18655:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663872384 00000100:00100000:0.0:1790779277.928675:0:18655:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663872384 00000100:00100000:0.0:1790779277.928753:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790779277.928762:0:18655:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663872384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790779277.928800:0:18655:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790779277.928848:0:18655:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663872384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779277.928855:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1790779277.928895:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790779277.928935:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663872384:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790779277.930351:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790779278.101546:0:20921:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790779278.128583:0:20921:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1790779278.128784:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.128801:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.128809:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.128818:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.128868:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790779278.128875:0:20921:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790779278.128929:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790779278.128936:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790779278.128943:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790779278.128951:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9b7603229800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790779278.128957:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790779278.128959:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790779278.128962:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790779278.131149:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779278.131164:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779278.131178:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779278.131183:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779278.131195:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779278.131203:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779278.131211:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790779278.131214:0:17134:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790779278.131218:0:17134:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790779278.131279:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779278.131287:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779278.131341:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779278.131349:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76039a2200/0xb1aa4014e936de25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936de2c expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779278.131363:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779278.131365:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779278.131366:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1790779278.131367:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779278.131391:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663872512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779278.131485:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779278.132187:0:17132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663872512 00000100:00100000:3.0:1790779278.132198:0:17132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663872512 00000100:00100000:3.0:1790779278.132257:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790779278.132267:0:17132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1877767663872512:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790779278.132274:0:17132:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790779278 with bad export cookie 12802115349310266448 00010000:00010000:2.0:1790779278.133505:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133603:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133677:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133686:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133709:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779278.133717:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133724:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133760:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133766:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133787:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790779278.133795:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133802:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133809:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133816:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133828:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1790779278.133833:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133840:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133846:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133866:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779278.133873:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1790779278.133896:0:20921:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1790779278.133932:0:20921:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1790779278.133937:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1790779278.133942:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779278.133949:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1790779278.133957:0:20921:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9b760342d800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790779278.133962:0:20921:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9b77041d0800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790779278.133969:0:20921:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9b77340f99c0) has exports, disconnecting them 00000020:00080000:2.0:1790779278.133974:0:20921:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9b760342d800), last request at 1790779273 00000020:00000080:2.0:1790779278.133985:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e063 00000100:00080000:2.0:1790779278.134009:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9b760342f000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790779278.134077:0:20921:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b760342d800): rc 0 00000020:00000080:2.0:1790779278.134080:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b760342d800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1790779278.134093:0:20921:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9b77041d0800), last request at 1790779273 00000020:00000080:2.0:1790779278.134096:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936df05 00000100:00080000:2.0:1790779278.134114:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9b77041d4000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790779278.134120:0:20921:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b77041d0800): rc 0 00000020:00000080:2.0:1790779278.134122:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b77041d0800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1790779278.134130:0:20921:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbc92c1887ae0 00000100:00080000:2.0:1790779278.134155:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790779278.134167:0:20921:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9b7735c14a80 x1877767663870592/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790779289 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779278.134194:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1790779278.136221:0:20173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790779278.136244:0:20173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136284:0:20173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7a00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790779278.136290:0:20173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136303:0:20173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790779278.136312:0:20173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779278.136318:0:20173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790779278.136323:0:20173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1790779278.136327:0:20173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1790779278.136395:0:20173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136403:0:20173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790779278.136436:0:20173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136445:0:20173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be7a00/0xb1aa4014e936dd84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dd8b expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136462:0:20173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790779278.136466:0:20173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136472:0:20173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790779278.136476:0:20173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136494:0:20173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790779278.136501:0:20173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779278.136506:0:20173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790779278.136509:0:20173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1790779278.136511:0:20173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790779278.136528:0:20173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136535:0:20173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790779278.136553:0:20173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136560:0:20173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894b400/0xb1aa4014e936e071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e078 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136576:0:20173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790779278.136580:0:20173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136586:0:20173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6e00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790779278.136589:0:20173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.136597:0:20173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779278.138300:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663872640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779278.138409:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779278.138596:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663870592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779278.138666:0:17133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663872640 00000100:00100000:1.0:1790779278.138677:0:17133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663872640 10000000:00010000:0.0:1790779278.138908:0:20173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779278.138916:0:20173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790779278.138919:0:20173:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790779278.138923:0:20173:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790779278.138987:0:20173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.138996:0:20173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790779278.139013:0:20173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.139152:0:20173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e21c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936e223 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.139171:0:20173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779278.139177:0:20173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.139185:0:20173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790779278.139188:0:20173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.139198:0:20173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790779278.139205:0:20173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779278.139223:0:20173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790779278.139225:0:20173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790779278.139228:0:20173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790779278.139284:0:20173:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.139292:0:20173:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790779278.139308:0:20173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779278.139315:0:20173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936dd76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1aa4014e936dd7d expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779278.139327:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1790779278.139330:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779278.139331:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779278.139333:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779278.139337:0:17133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1877767663872640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790779278.139345:0:17133:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790779278 with bad export cookie 12802115349310266448 00000100:00100000:1.0:1790779278.139412:0:17133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1877767663872640:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1004us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790779278.139420:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1790779278.140181:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790779278.140193:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9b771828f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1790779278.140774:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790779278.140780:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9b770ea17000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1790779278.140786:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1790779278.140853:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779278.140862:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790779278.140931:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760342d800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1790779278.141005:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77041d0800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1790779278.141038:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b760342f000 for lustre-MDT0001 00000020:00000080:2.0:1790779278.141044:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b77041d4000 for lustre-MDT0001 00000100:00100000:3.0:1790779278.163370:0:17132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1877767663872512:12345-0@lo:103:ldlm_bl.0 Request processed in 31093us (31874us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790779278.163390:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1790779278.164382:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790779278.164390:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1790779278.164415:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790779278.164631:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790779278.164668:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9b7711492000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1790779278.164690:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790779278.164694:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1790779278.164717:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779278.165026:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663873152:0@lo:9:umount.0 00000100:00100000:3.0:1790779278.165124:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779278.165341:0:18653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663873152 00000100:00100000:3.0:1790779278.165352:0:18653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663873152 00000100:00100000:3.0:1790779278.165435:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790779278.165446:0:18653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1877767663873152:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790779278.165497:0:18653:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936df2f 00000100:00080000:3.0:1790779278.165509:0:18653:0:(import.c:65:import_set_state_nolock()) ffff9b77041d7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790779278.165635:0:18653:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1790779278.165832:0:18653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3648:x1877767663873152:12345-0@lo:9:umount.0 Request processed in 387us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779278.165839:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1790779278.165980:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7711492000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790779278.165986:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790779278.165987:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779278.165991:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663873152:0@lo:9:umount.0 00000100:00080000:3.0:1790779278.166011:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1790779278.166025:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790779278.166045:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663873280:0@lo:9:umount.0 00000100:00100000:3.0:1790779278.166071:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779278.166096:0:19170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663873280 00000100:00100000:3.0:1790779278.166099:0:19170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663873280 00000100:00100000:3.0:1790779278.166138:0:19170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790779278.166377:0:19170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1877767663873280:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790779278.166396:0:19170:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e094 00000100:00080000:3.0:1790779278.166404:0:19170:0:(import.c:65:import_set_state_nolock()) ffff9b760342e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790779278.166435:0:19170:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1790779278.166662:0:19170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3648:x1877767663873280:12345-0@lo:9:umount.0 Request processed in 516us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779278.166669:0:19170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1790779278.166718:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7734583000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790779278.166743:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790779278.166745:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779278.166748:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663873280:0@lo:9:umount.0 00000020:00080000:3.0:1790779278.166805:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9b77340f99c0) has no exports 00010000:00010000:3.0:1790779278.179895:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790779278.190450:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.103@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1790779278.190458:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790779278.190472:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7603833100 x1877767663870848/t0(0) o400->MGC192.168.203.103@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790779289 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779278.190491:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7603832a00 x1877767663872512/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790779294 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779278.191588:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7603bd0380 x1877767663872640/t0(0) o103->MGC192.168.203.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790779294 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779278.191677:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f89954ec-b1b4-4b66-a198-81b81a38f825:0:1877767663873024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779278.192264:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f89954ec-b1b4-4b66-a198-81b81a38f825:0:1877767663872896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779278.192293:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f89954ec-b1b4-4b66-a198-81b81a38f825:3652:1877767663870848:0@lo:400:kworker.0 00010000:00010000:2.0:1790779278.192323:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790779278.194988:0:17142:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779278.197405:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f89954ec-b1b4-4b66-a198-81b81a38f825:0:1877767663872768:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1790779278.200858:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790779278.200871:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790779278.200873:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790779278.200910:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9b770ea17000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779278.200922:0:3650:0:(import.c:545:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 498 00000100:00080000:1.0:1790779278.200942:0:3650:0:(import.c:666:import_select_connection()) MGC192.168.203.103@tcp: import ffff9b770ea17000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779278.201001:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603746d80 x1877767663873408/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779278.201054:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663872512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779278.201102:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f89954ec-b1b4-4b66-a198-81b81a38f825:3650:1877767663872640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790779278.201510:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f89954ec-b1b4-4b66-a198-81b81a38f825:3648:1877767663873408:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1790779278.201583:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877767663873408 offset 0 length 520: 4 00000020:00080000:2.0:1790779278.209788:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9b77340f99c0) has no exports 00000020:01000000:3.0:1790779278.326573:0:20921:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b7735bf5d80 - data ffff9b770e326438/ffff9b7603171000 00000020:01000000:3.0:1790779278.326856:0:20921:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b773b4e2cc0 - data ffff9b770e09bca8/ffff9b773acc0c00 00000001:00000004:1.0:1790779278.342172:0:20921:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1790779278.448103:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790779278.448116:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790779278.448126:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1790779278.453592:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790779278.453604:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1790779278.453626:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779278.453630:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790779278.454032:0:17887:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790779278.454038:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1790779278.454049:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1790779278.465817:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790779278.465830:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1790779278.465861:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779278.466002:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790779278.467172:0:17889:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790779278.467180:0:17889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1790779278.467328:0:17889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1790779278.477683:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dd99 00000020:00000080:0.0:1790779278.477711:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b773b6d4800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790779278.478065:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790779278.488071:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936ddae 00000020:00000080:3.0:1790779278.488094:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b773b6d4000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790779278.488167:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1790779278.488186:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779278.488200:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790779278.488206:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9b77340fb380) has no exports 00000004:01000000:3.0:1790779278.488441:0:20921:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790779278.488453:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936de02 00000020:00000080:3.0:1790779278.488459:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b7603883000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790779278.495338:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1790779278.498947:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1790779278.498994:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779278.499011:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790779278.499017:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9b77340999c0) has no exports 00000020:00000080:3.0:1790779278.499033:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936ddfb 00000020:00000080:3.0:1790779278.499045:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b77156a0000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790779278.502555:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603883000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1790779278.504849:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77156a0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1790779278.506845:0:20921:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1790779278.506857:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790779278.506862:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1790779278.506873:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779278.506875:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790779278.507047:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779278.507063:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790779278.507074:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dded 00000020:00000080:3.0:1790779278.507087:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b7603885000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1790779278.507095:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1790779278.507107:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779278.507109:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7734583000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790779278.507113:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790779278.507117:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9b7603220000) has no exports 00000020:00000080:1.0:1790779278.507118:0:36:0:(genops.c:885:class_export_put()) final put ffff9b7603883800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790779278.507122:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603883800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790779278.507127:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dddf 00000020:00000080:3.0:1790779278.507130:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b7711496800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1790779278.507130:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790779278.513451:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603885000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1790779278.513472:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7711496800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1790779278.521674:0:20921:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1790779278.521686:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790779278.521692:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1790779278.522019:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790779278.522022:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790779278.522169:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779278.522196:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1790779278.522218:0:20921:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1790779278.522305:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936ddd1 00000020:00000080:3.0:1790779278.522318:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b77342fa000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790779278.524176:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7711492000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1790779278.525349:0:36:0:(genops.c:885:class_export_put()) final put ffff9b7718289800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790779278.525354:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7718289800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1790779278.525364:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790779278.526026:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77342fa000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1790779278.526284:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1790779278.526722:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779278.526749:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790779278.526755:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9b7603224d40) has no exports 00000020:00000080:1.0:1790779278.526768:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936ddca 00000020:00000080:1.0:1790779278.526781:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b771828e000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790779278.526927:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b771828e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1790779278.552144:0:20921:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1790779278.552156:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790779278.552162:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790779278.552172:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790779278.552374:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779278.552390:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790779278.552426:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779278.552429:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790779278.552436:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b773b6d2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790779278.552442:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1790779278.552450:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790779278.552680:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936ddb5 00000020:00000080:1.0:1790779278.552689:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b773b6d7800/lustre-MDD0001_UUID 00000020:00000080:3.0:1790779278.552867:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b771828f800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1790779278.552905:0:36:0:(genops.c:885:class_export_put()) final put ffff9b77208ae800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790779278.552907:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77208ae800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1790779278.552914:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790779278.553366:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d7800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1790779278.553413:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1790779278.553420:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779278.553429:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790779278.553435:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9b77340f8000) has no exports 00000020:00000080:1.0:1790779278.553463:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779278.553467:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1790779278.553470:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b773b6d1000/lustre-MDD0001_UUID 00000020:00000080:1.0:1790779278.553472:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d1000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1790779278.553476:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1790779278.553596:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936ddbc 00000020:00000080:1.0:1790779278.553604:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b773b6d5000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1790779278.553626:0:20921:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b7703509000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1790779278.553645:0:20921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b7703509000 2 00000020:01000004:1.0:1790779278.553650:0:20921:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b7703509000 from lustre-MDT0001 00000020:00000080:1.0:1790779278.553677:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779278.553681:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1790779278.553685:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b773b6d7000/lustre-MDT0001_UUID 00000020:00000080:1.0:1790779278.553687:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d7000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1790779278.553790:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1790779278.553819:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1790779278.553856:0:20921:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1790779278.553861:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1790779278.553863:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779278.553867:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790779278.553876:0:20921:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9b7711bf7000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790779278.554068:0:20921:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9b773409b380) has exports, disconnecting them 00000020:00080000:1.0:1790779278.554074:0:20921:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9b7711bf7000), last request at 1790779196 00000020:00000080:1.0:1790779278.554079:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936de3a 00000020:00080000:1.0:1790779278.554087:0:20921:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b7711bf7000): rc 0 00000020:00000080:1.0:1790779278.554091:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b7711bf7000/lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1790779278.554977:0:20921:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1790779278.554984:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790779278.554989:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790779278.554997:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790779278.555434:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7711bf7000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1790779278.555778:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779278.555789:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1790779278.555800:0:20921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b7703509000 1 00000020:00000080:1.0:1790779278.555806:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dd61 00000020:00000080:1.0:1790779278.555817:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b770350b000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790779278.555842:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7603229800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1790779278.555850:0:36:0:(genops.c:885:class_export_put()) final put ffff9b760310a000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1790779278.555853:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760310a000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1790779278.555860:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:1.0:1790779278.556196:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1790779278.556203:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779278.556210:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790779278.556215:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9b773059b380) has no exports 00000020:00000080:3.0:1790779278.558348:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b770350b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790779278.702831:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779278.702853:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1790779278.702857:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b770350f800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790779278.702862:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9b770350f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1790779278.702867:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1790779278.703086:0:20921:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b770350d800 00000020:01000000:1.0:1790779278.703105:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790779278.703108:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779278.703111:0:20921:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790779278.703114:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9b7603223380) has no exports 00000100:00100000:1.0:1790779278.703191:0:20632:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff9b773af0c400:20632] 4 exiting: rc = 0 00000100:00100000:3.0:1790779278.703217:0:17147:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff9b772ff58c00:17147] 1 exiting: rc = 0 00000100:00100000:2.0:1790779278.703318:0:19938:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff9b7602643a00:19938] 3 exiting: rc = 0 00000100:00100000:1.0:1790779278.703330:0:17146:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff9b772ff58000:17146] 0 exiting: rc = 1 00000100:00100000:0.0:1790779278.703401:0:17148:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff9b77168ce000:17148] 2 exiting: rc = 0 00000100:00100000:1.0:1790779278.703439:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703450:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703455:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703461:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703467:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703472:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703477:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703483:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703489:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703494:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703500:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703506:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703754:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703765:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703770:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703775:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703781:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703786:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703791:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703796:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703802:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703807:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703812:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703827:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703833:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703838:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703843:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703849:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703855:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703862:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703868:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.703873:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704019:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704027:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704044:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704050:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704057:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704063:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704069:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704076:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704081:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704086:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704091:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704097:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704101:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704106:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704111:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704116:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704122:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704127:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704132:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704138:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704144:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704150:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704156:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704161:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704165:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704168:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704179:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704183:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704187:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704190:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704193:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.704197:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.707184:0:17149:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b77208f5400:17149] 0 exiting: rc = 1 00000100:00100000:2.0:1790779278.707325:0:17150:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b77208f5e00:17150] 1 exiting: rc = 0 00000100:00100000:0.0:1790779278.707858:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.707876:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708129:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708135:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708140:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708145:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708151:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708155:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708160:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708165:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708169:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708174:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708179:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708186:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708191:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708196:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708202:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708207:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708212:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708217:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708222:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708227:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708231:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708236:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708241:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708246:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708251:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708256:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708261:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708266:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708271:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708275:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708281:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708286:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708291:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708296:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708310:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708315:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708321:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708326:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708331:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708336:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708340:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708345:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708349:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708353:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708358:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708362:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708386:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708435:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708440:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708443:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708446:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708449:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708452:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708456:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708459:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708462:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708466:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708468:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708471:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708474:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708477:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.708480:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709151:0:17152:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff9b760376f200:17152] 1 exiting: rc = 0 00000100:00100000:3.0:1790779278.709266:0:17151:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff9b760376f800:17151] 0 exiting: rc = 1 00000100:00100000:1.0:1790779278.709423:0:18106:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff9b773ae37000:18106] 2 exiting: rc = 0 00000100:00100000:2.0:1790779278.709535:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709540:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709546:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709552:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709558:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709565:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709571:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709577:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709583:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709589:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709594:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709601:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709622:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709626:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709630:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709634:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709638:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709642:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709646:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709651:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709655:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709659:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709663:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709667:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709681:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709686:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709690:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709694:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709698:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709701:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709705:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709709:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709713:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709717:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709720:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709737:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709757:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709765:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709772:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709778:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709784:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709790:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709795:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709803:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709808:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709815:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709820:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709832:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709851:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709857:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709862:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709867:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709874:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709912:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709919:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709925:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709931:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709936:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709941:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709946:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709967:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709973:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709979:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.709984:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.716863:0:17153:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b7711c79600:17153] 0 exiting: rc = 1 00000100:00100000:0.0:1790779278.716951:0:17154:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b77168cea00:17154] 1 exiting: rc = 0 00000100:00100000:2.0:1790779278.717090:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717097:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717102:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717107:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717113:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717119:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717124:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717129:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717134:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717139:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717144:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717149:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717154:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717159:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717163:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717168:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717172:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717176:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717195:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717199:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717204:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717209:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717213:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717217:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717222:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717228:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717233:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717238:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717242:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717247:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717252:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717258:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717263:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717268:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717274:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717279:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717285:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717290:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717296:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717301:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717306:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717315:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717321:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717326:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717331:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717336:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717341:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717345:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717350:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717355:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717359:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717364:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717368:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717380:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717385:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717389:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717394:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717399:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717403:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717408:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717413:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717418:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717423:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.717428:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.717858:0:17156:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b77305a4200:17156] 1 exiting: rc = 0 00000100:00100000:0.0:1790779278.718142:0:17155:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b7711c79800:17155] 0 exiting: rc = 1 00000100:00100000:2.0:1790779278.718179:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718189:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718198:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718203:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718208:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718214:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718219:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718225:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718236:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718242:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718248:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718266:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718272:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718278:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718283:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718289:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718294:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718300:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718305:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718311:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718316:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718322:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718327:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718332:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718346:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718352:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718358:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718364:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718370:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718376:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718381:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718387:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718392:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718397:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718476:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718485:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718491:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718497:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718502:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718508:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718513:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718518:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718523:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718539:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718544:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718549:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718554:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718559:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718563:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718568:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718572:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718578:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718584:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718588:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718593:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718599:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718604:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718609:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718613:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718626:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718631:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718636:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718641:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.718647:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779278.719145:0:17158:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b771da45e00:17158] 1 exiting: rc = 0 00000100:00100000:3.0:1790779278.719341:0:17157:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b7603726000:17157] 0 exiting: rc = 1 00000100:00100000:2.0:1790779278.725246:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725258:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725263:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725269:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725273:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725278:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725283:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725287:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725293:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725297:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725302:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725306:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725310:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725316:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725320:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725324:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725328:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725333:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725337:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725342:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725347:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725351:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725357:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725362:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725368:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725374:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725379:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725385:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725390:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725395:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725419:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725423:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725429:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725434:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725439:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725444:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725449:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725455:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725460:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725466:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725471:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725476:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725481:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725486:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725491:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725496:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725512:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725518:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725522:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725527:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725532:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725537:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725543:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725548:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725553:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725559:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725564:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725569:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725574:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725579:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725584:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725589:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725594:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779278.725599:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779278.728994:0:17159:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff9b77342a1200:17159] 0 exiting: rc = 1 00000100:00100000:1.0:1790779278.729530:0:17160:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff9b77342a0600:17160] 1 exiting: rc = 0 00000100:00100000:3.0:1790779278.731318:0:17161:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff9b7712a65a00:17161] 2 exiting: rc = 0 00000100:00100000:3.0:1790779278.731420:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731429:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731435:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731441:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731446:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731461:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731467:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731473:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731478:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731483:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731501:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731506:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731512:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731518:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731531:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731538:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731543:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731549:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731554:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731560:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731566:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731573:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731578:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731584:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731590:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731595:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731601:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731609:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731615:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731621:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731627:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731633:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731638:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731644:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731649:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731655:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731661:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731666:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731685:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731692:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731698:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731703:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731709:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731714:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731719:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731745:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731751:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731758:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731764:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731771:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731776:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731782:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731788:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731793:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731799:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731805:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731811:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731816:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731822:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731827:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731833:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731838:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731845:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779278.731861:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790779278.742557:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779278.742583:0:20921:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1790779278.742589:0:20921:0:(genops.c:885:class_export_put()) final put ffff9b760322a800/MDS_uuid 00000020:00000080:2.0:1790779278.742594:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760322a800/MDS_uuid for MDS 00000020:01000000:2.0:1790779278.742605:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1790779278.742764:0:20921:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1790779278.952327:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790779278.953316:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779278.953323:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790779278.953327:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b773f4fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779278.953335:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 591 00000100:00080000:2.0:1790779278.953340:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790779278.953351:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b773f4fe000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779278.953393:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7735c15500 x1877767663873536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779278.953448:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779278.953452:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790779278.953453:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7720129800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779278.953457:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 591 00000100:00080000:2.0:1790779278.953459:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790779278.953464:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b7720129800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779278.953475:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7735c17b80 x1877767663873792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779278.953525:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779278.953541:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663873664:0@lo:400:kworker.0 00000100:00100000:0.0:1790779278.954209:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663873920:0@lo:400:kworker.0 00000400:00000100:0.0:1790779278.954345:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663873920 offset 0 length 224: 4 00000100:00100000:3.0:1790779278.954451:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663873536:0@lo:38:kworker.0 00000400:00000100:3.0:1790779278.954475:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663873536 offset 0 length 520: 4 00000100:00100000:3.0:1790779278.954490:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663873792:0@lo:38:kworker.0 00000400:00000100:3.0:1790779278.954505:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663873792 offset 0 length 520: 4 00000400:00000100:2.0:1790779278.954791:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663873664 offset 0 length 224: 4 00010000:00010000:3.0:1790779279.979117:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779281.004907:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779282.046661:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779283.050973:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790779283.400383:0:21121:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790779283.410033:0:21121:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1790779283.410100:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779283.410113:0:21121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779283.410136:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779283.410143:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779283.410169:0:21121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790779283.410174:0:21121:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790779283.410203:0:21121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790779283.410213:0:21121:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7735c15500 x1877767663873536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779293 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779283.410229:0:21121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790779283.410259:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773f4fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00010000:0.0:1790779283.410310:0:20173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779283.410324:0:20173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779283.410332:0:20173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790779283.410337:0:20173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779283.410346:0:20173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790779283.410354:0:20173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779283.410364:0:20173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790779283.410367:0:20173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790779283.410370:0:20173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790779283.410383:0:20173:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b770ea17000 00010000:00010000:0.0:1790779283.410387:0:20173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779283.410398:0:20173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936ded4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936dedb expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779283.410410:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779283.410411:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779283.410413:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790779283.410918:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1790779283.410924:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663873536:0@lo:38:kworker.0 00000100:00080000:3.0:1790779283.410953:0:21121:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790779283.410959:0:21121:0:(import.c:65:import_set_state_nolock()) ffff9b773f4fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1790779283.410963:0:21121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790779283.410965:0:21121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790779283.410969:0:21121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1790779283.411075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f89954ec-b1b4-4b66-a198-81b81a38f825->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790779283.411080:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f89954ec-b1b4-4b66-a198-81b81a38f825->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790779283.411148:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663874048:0@lo:400:kworker.0 00000400:00000100:2.0:1790779283.411210:0:3652:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663874048 offset 0 length 224: 4 00000100:00080000:1.0:1790779283.411307:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790779283.411312:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790779283.411344:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779283.411356:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663874176:0@lo:400:kworker.0 00000400:00000100:1.0:1790779283.411625:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663874176 offset 0 length 224: 4 00000100:00080000:3.0:1790779283.412017:0:21121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790779283.412026:0:21121:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7735c15880 x1877767663873664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779294 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779283.412036:0:21121:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7603745180 x1877767663874048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779299 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779283.412052:0:21121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790779283.412064:0:21121:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790779283.412076:0:21121:0:(import.c:65:import_set_state_nolock()) ffff9b771270d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790779283.412180:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1877767663874304:0@lo:39:umount.0 00000400:00000100:3.0:1790779283.412204:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663874304 offset 0 length 224: 4 00000100:00100000:2.0:1790779283.412329:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663874048:0@lo:400:kworker.0 00000100:00100000:0.0:1790779283.414156:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663873664:0@lo:400:kworker.0 00010000:00010000:3.0:1790779284.073896:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790779284.075155:0:18648:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790779284.075163:0:18648:0:(genops.c:885:class_export_put()) final put ffff9b77041d3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790779284.075244:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77041d3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790779284.075288:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b77041d7800 for lustre-OST0000 00000001:00100000:1.0:1790779284.075467:0:19466:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790779284.075472:0:19466:0:(genops.c:885:class_export_put()) final put ffff9b7603428000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790779284.075524:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603428000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790779284.075558:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b760342e800 for lustre-OST0001 00010000:00010000:3.0:1790779285.096616:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779286.120766:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779287.145233:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779288.169035:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779288.553700:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779278/real 1790779278] req@ffff9b7603746d80 x1877767663873408/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790779288 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779288.553735:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603746d80 x1877767663873408/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790779288 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790779288.553754:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b770ea17000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790779288.553779:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1790779288.553784:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f89954ec-b1b4-4b66-a198-81b81a38f825:3648:1877767663873408:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1790779288.554340:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) f89954ec-b1b4-4b66-a198-81b81a38f825->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790779288.554345:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1790779288.554348:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b770ea17000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779288.554353:0:9333:0:(import.c:545:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 596 00000100:00080000:0.0:1790779288.554358:0:9333:0:(import.c:630:import_select_connection()) MGC192.168.203.103@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790779288.554368:0:9333:0:(import.c:666:import_select_connection()) MGC192.168.203.103@tcp: import ffff9b770ea17000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779288.554400:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7711bf9880 x1877767663874432/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790779288.554426:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790779288.554429:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790779288.554776:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663874560:0@lo:400:kworker.0 00000400:00000100:1.0:1790779288.554835:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663874560 offset 0 length 224: 4 00000100:00100000:3.0:1790779288.555027:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f89954ec-b1b4-4b66-a198-81b81a38f825:3648:1877767663874432:0@lo:250:kworker.0 00000400:00000100:3.0:1790779288.555051:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877767663874432 offset 0 length 520: 4 00010000:00010000:0.0:1790779289.195716:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779290.216210:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779291.244295:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779292.264186:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779293.288499:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779293.673830:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779283/real 1790779283] req@ffff9b7603832d80 x1877767663874304/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790779293 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779293.673865:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603832d80 x1877767663874304/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790779293 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779293.673875:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779278/real 1790779278] req@ffff9b7735c17b80 x1877767663873792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790779293 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779293.673944:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7735c17b80 x1877767663873792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790779293 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790779293.673963:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b771270d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790779293.673976:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1877767663874304:0@lo:39:umount.0 00000100:00080000:3.0:1790779293.673983:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7720129800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790779293.674010:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790779293.674013:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663873792:0@lo:38:kworker.0 00000100:00080000:0.0:1790779293.674146:0:21121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790779293.674151:0:21121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790779293.674156:0:21121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790779293.675059:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779293.675074:0:21121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779293.675082:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779293.675089:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779293.675118:0:21121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790779293.675126:0:21121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779293.675151:0:21121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779293.675158:0:21121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779293.675164:0:21121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779293.675186:0:21121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790779293.675191:0:21121:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1790779293.675217:0:21121:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1790779293.675221:0:21121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1790779293.675225:0:21121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790779293.675231:0:21121:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790779293.675235:0:21121:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9b7741168000) has no exports 00000020:00080000:0.0:1790779293.675261:0:21121:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9b7741168000) has no exports 00010000:00010000:1.0:1790779293.675274:0:20173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790779293.675283:0:20173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779293.675292:0:20173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769e00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779293.675303:0:20173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779293.675313:0:20173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779293.675320:0:20173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779293.675326:0:20173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790779293.675329:0:20173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1790779293.675331:0:20173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1790779293.675346:0:20173:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b770ea17000 00010000:00010000:1.0:1790779293.675350:0:20173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779293.675357:0:20173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718769e00/0xb1aa4014e936deaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936deb1 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779293.675371:0:20173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779293.675374:0:20173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779293.675380:0:20173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7e00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779293.675383:0:20173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779293.675390:0:20173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779293.675397:0:20173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779293.675408:0:20173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790779293.675410:0:20173:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790779293.675411:0:20173:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790779293.675417:0:20173:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b770ea17000 00010000:00010000:1.0:1790779293.675420:0:20173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779293.675425:0:20173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be7e00/0xb1aa4014e936e20e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936e215 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779293.675433:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779293.675435:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779293.675436:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790779293.676991:0:21121:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b7735bf50c0 - data ffff9b770e28eca8/ffff9b773af78800 00000020:01000000:0.0:1790779293.677118:0:21121:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b773b4e27e0 - data ffff9b770e011a20/ffff9b773acd6400 00000100:00080000:2.0:1790779293.677498:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) f89954ec-b1b4-4b66-a198-81b81a38f825->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779293.677504:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) f89954ec-b1b4-4b66-a198-81b81a38f825->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779293.677507:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790779293.677511:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790779293.677514:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7720129800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779293.677521:0:9333:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 596 00000100:00080000:2.0:1790779293.677528:0:9333:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790779293.677538:0:9333:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b7720129800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779293.677575:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7735c17800 x1877767663874688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779293.677658:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779293.677674:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663874816:0@lo:400:kworker.0 00000400:00000100:2.0:1790779293.677723:0:3652:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663874816 offset 0 length 224: 4 00010000:00010000:3.0:1790779293.678185:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779293.678200:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663874688:0@lo:38:kworker.0 00000400:00000100:3.0:1790779293.678227:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663874688 offset 0 length 520: 4 00100000:10000000:0.0:1790779293.698110:0:21121:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790779293.714286:0:21121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936debf 00000020:00000080:3.0:1790779293.714298:0:21121:0:(genops.c:885:class_export_put()) final put ffff9b7734248000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1790779293.714314:0:21121:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b77340a4000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1790779293.714318:0:21121:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b77340a4000 2 00000020:01000004:3.0:1790779293.714321:0:21121:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b77340a4000 from lustre-OST0000 00000020:00000080:3.0:1790779293.714348:0:21121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779293.714369:0:21121:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1790779293.714373:0:21121:0:(genops.c:885:class_export_put()) final put ffff9b773424e800/lustre-OST0000_UUID 00000020:00000080:3.0:1790779293.714376:0:21121:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773424e800/lustre-OST0000_UUID for lustre-OST0000 00000020:00000080:1.0:1790779293.714891:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7734248000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1790779293.715471:0:21121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1790779293.715537:0:21121:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1790779293.715542:0:21121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1790779293.715545:0:21121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790779293.715552:0:21121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790779293.715559:0:21121:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b77041d0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790779293.715565:0:21121:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9b774116b380) has exports, disconnecting them 00000020:00080000:3.0:1790779293.715580:0:21121:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b77041d0000), last request at 1790779212 00000020:00000080:3.0:1790779293.715584:0:21121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dee9 00000020:00080000:3.0:1790779293.715719:0:21121:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b77041d0000): rc 0 00000020:00000080:3.0:1790779293.715724:0:21121:0:(genops.c:885:class_export_put()) final put ffff9b77041d0000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790779293.722770:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77041d0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1790779293.722867:0:21121:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790779293.722872:0:21121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790779293.722876:0:21121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790779293.722896:0:21121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790779293.722922:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b773f4fe000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790779293.723080:0:21121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790779293.723089:0:21121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790779293.723094:0:21121:0:(genops.c:885:class_export_put()) final put ffff9b773424a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790779293.723097:0:21121:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773424a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790779293.723102:0:21121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1790779293.723171:0:21121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1790779293.723176:0:21121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779293.723181:0:21121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790779293.723202:0:21121:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9b77041d6800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790779293.723222:0:21121:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff9b77305999c0) has exports, disconnecting them 00000020:00080000:1.0:1790779293.723227:0:21121:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9b77041d6800), last request at 1790779212 00000020:00000080:1.0:1790779293.723231:0:21121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936defe 00000020:00080000:1.0:1790779293.723245:0:21121:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b77041d6800): rc 0 00000020:00000080:1.0:1790779293.723249:0:21121:0:(genops.c:885:class_export_put()) final put ffff9b77041d6800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790779293.723283:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77041d6800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1790779293.727687:0:21121:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1790779293.727699:0:21121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790779293.727704:0:21121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790779293.727713:0:21121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790779293.727928:0:21121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779293.727938:0:21121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1790779293.727958:0:21121:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b77340a4000 1 00000020:00000080:2.0:1790779293.727965:0:21121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936de9c 00000020:00000080:2.0:1790779293.727973:0:21121:0:(genops.c:885:class_export_put()) final put ffff9b773b6d3000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1790779293.727978:0:21121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1790779293.727983:0:21121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779293.727987:0:21121:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790779293.727990:0:21121:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff9b773409cd40) has no exports 00000020:00000080:2.0:1790779293.745995:0:9333:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b771270d000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1790779293.746010:0:9333:0:(genops.c:885:class_export_put()) final put ffff9b7712708000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1790779293.746013:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7712708000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1790779293.746027:0:9333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1790779293.747030:0:9333:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790779293.899709:0:21121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790779293.899724:0:21121:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1790779293.899730:0:21121:0:(genops.c:885:class_export_put()) final put ffff9b77340a5000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1790779293.899734:0:21121:0:(genops.c:844:class_export_destroy()) destroying export ffff9b77340a5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1790779293.899747:0:21121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1790779293.899868:0:21121:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b77340a7000 00000020:02000400:3.0:1790779293.899929:0:21121:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00000400:0.0:1790779294.313671:0:3651:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779278/real 1790779278] req@ffff9b7735c16680 x1877767663873920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790779294 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1790779294.314685:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779294.345436:0:3651:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9b7735c16680 x1877767663873920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790779294 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790779294.345451:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9b7603411800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790779294.345455:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790779294.397231:0:3651:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1790779294.397454:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663873920:0@lo:400:kworker.0 00000100:00080000:3.0:1790779294.397584:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f89954ec-b1b4-4b66-a198-81b81a38f825->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790779294.397590:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f89954ec-b1b4-4b66-a198-81b81a38f825->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779294.397592:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790779294.397595:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779294.397597:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790779294.397600:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790779294.397604:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7603411800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779294.397618:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 545 00000100:00080000:3.0:1790779294.397631:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b7603411800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779294.397671:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603832d80 x1877767663874944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779294.397711:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1877767663874944:0@lo:38:kworker.0 00000400:00000100:3.0:1790779294.397759:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877767663874944 offset 0 length 520: 4 00010000:00010000:1.0:1790779295.336003:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779296.361476:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779297.385186:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790779297.857503:0:21325:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790779297.872868:0:21325:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1790779297.873374:0:21325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.873460:0:21325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.873468:0:21325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.873476:0:21325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.873535:0:21325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790779297.873541:0:21325:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790779297.873570:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790779297.873593:0:21325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7735c17800 x1877767663874688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779313 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779297.873613:0:21325:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790779297.873619:0:21325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790779297.873625:0:21325:0:(import.c:65:import_set_state_nolock()) ffff9b7720129800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790779297.873634:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790779297.873654:0:21325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7735c17800 x1877767663874688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779313 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779297.873661:0:21325:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790779297.873665:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1790779297.873740:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663874688:0@lo:38:kworker.0 00010000:00010000:2.0:1790779297.873817:0:20173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779297.873826:0:20173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779297.873834:0:20173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768e00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779297.873838:0:20173:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779297.873848:0:20173:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779297.873856:0:20173:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779297.873862:0:20173:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790779297.873864:0:20173:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790779297.873866:0:20173:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790779297.873904:0:20173:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b770ea17000 00010000:00010000:2.0:1790779297.873909:0:20173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779297.873916:0:20173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7718768e00/0xb1aa4014e936e032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936e039 expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779297.873927:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779297.873936:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779297.873938:0:20173:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790779297.875706:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790779297.875725:0:21325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7603745500 x1877767663874176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779299 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779297.875760:0:21325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7711bfad80 x1877767663874560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779304 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779297.875769:0:21325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7735c15f80 x1877767663874816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779309 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779297.875787:0:21325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7603832d80 x1877767663874944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779304 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779297.875796:0:21325:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790779297.875801:0:21325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790779297.875807:0:21325:0:(import.c:65:import_set_state_nolock()) ffff9b7603411800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790779297.875812:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790779297.875816:0:21325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7603745500 x1877767663874176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779299 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779297.875823:0:21325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7711bfad80 x1877767663874560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779304 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779297.875831:0:21325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7735c15f80 x1877767663874816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779309 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779297.875838:0:21325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7603832d80 x1877767663874944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790779304 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779297.875843:0:21325:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790779297.875846:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1790779297.876015:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663874816:0@lo:400:kworker.0 00000100:00100000:2.0:1790779297.876704:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663874560:0@lo:400:kworker.0 00000100:00100000:2.0:1790779297.876714:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1877767663874176:0@lo:400:kworker.0 00000100:00100000:3.0:1790779297.876845:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1877767663874944:0@lo:38:kworker.0 00010000:00010000:1.0:1790779297.877826:0:21325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.877841:0:21325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.877849:0:21325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.877856:0:21325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.877904:0:21325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790779297.877911:0:21325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.877918:0:21325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.877924:0:21325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.877931:0:21325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779297.877947:0:21325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1790779297.877952:0:21325:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1790779297.877976:0:21325:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1790779297.877980:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1790779297.877985:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790779297.877991:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790779297.878006:0:21325:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9b7730598000) has no exports 00000020:00080000:1.0:1790779297.878030:0:21325:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9b7730598000) has no exports 00010000:00010000:3.0:1790779297.878714:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779297.878723:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779297.878732:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779297.878736:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779297.878745:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779297.878752:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779297.878758:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790779297.878761:0:17134:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1790779297.878763:0:17134:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1790779297.878776:0:17134:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b770ea17000 00010000:00010000:3.0:1790779297.878780:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779297.878787:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7701663400/0xb1aa4014e936e008 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936e00f expref: -99 pid: 19465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779297.878802:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779297.878806:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779297.878825:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2a00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779297.878828:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779297.878835:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779297.878841:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779297.878846:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790779297.878848:0:17134:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790779297.878850:0:17134:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790779297.878857:0:17134:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b770ea17000 00010000:00010000:3.0:1790779297.878860:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779297.878866:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76039a2a00/0xb1aa4014e936e200 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936e207 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779297.878902:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779297.878904:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779297.878906:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779297.879271:0:17135:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790779297.881545:0:21325:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b7735bf5f00 - data ffff9b770e276288/ffff9b773af78c00 00000020:01000000:1.0:1790779297.881718:0:21325:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9b760348eae0 - data ffff9b771373c288/ffff9b7604497c00 00100000:10000000:1.0:1790779297.889347:0:21325:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790779297.897941:0:21325:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e01d 00000020:00000080:0.0:1790779297.897952:0:21325:0:(genops.c:885:class_export_put()) final put ffff9b7603bda800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1790779297.897967:0:21325:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b773424c000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1790779297.897970:0:21325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b773424c000 2 00000020:01000004:0.0:1790779297.897973:0:21325:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b773424c000 from lustre-OST0001 00000020:00000080:0.0:1790779297.898230:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790779297.898301:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1790779297.898305:0:21325:0:(genops.c:885:class_export_put()) final put ffff9b7603bda000/lustre-OST0001_UUID 00000020:00000080:0.0:1790779297.898308:0:21325:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603bda000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1790779297.898314:0:21325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1790779297.898402:0:21325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f89954ec-b1b4-4b66-a198-81b81a38f825->MGS 00010000:00010000:0.0:1790779297.898418:0:21325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936dd68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936dd6f expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790779297.898429:0:21325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936dd68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936dd6f expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779297.898435:0:21325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1790779297.898438:0:21325:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1790779297.898442:0:21325:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1790779297.898456:0:21325:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b770ea17000 00010000:00010000:0.0:1790779297.898460:0:21325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936dd68 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936dd6f expref: -99 pid: 17878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779297.898475:0:21325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790779297.898492:0:21325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779297.898497:0:21325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790779297.898500:0:21325:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1790779297.898501:0:21325:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1790779297.898517:0:21325:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b770ea17000 00010000:00010000:0.0:1790779297.898520:0:21325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76039a3400/0xb1aa4014e936dc57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1aa4014e936dc5e expref: -99 pid: 17125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790779297.898538:0:21325:0:(import.c:65:import_set_state_nolock()) ffff9b770ea17000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1790779297.898542:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790779297.898545:0:21325:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790779297.898546:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790779297.898550:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790779297.898561:0:21325:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b7711bf9880 x1877767663874432/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790779303 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790779297.898590:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790779297.898593:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:3.0:1790779297.898773:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f89954ec-b1b4-4b66-a198-81b81a38f825:3648:1877767663874432:0@lo:250:kworker.0 10000000:01000000:0.0:1790779297.898826:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790779297.898834:0:21325:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936dc42 00000020:00000080:0.0:1790779297.898839:0:21325:0:(genops.c:885:class_export_put()) final put ffff9b760322d800/f89954ec-b1b4-4b66-a198-81b81a38f825 00000020:01000000:0.0:1790779297.898845:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.103@tcp (flags='') 00000020:00000080:0.0:1790779297.898850:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790779297.898854:0:21325:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790779297.898858:0:21325:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9b773b784d40) has no exports 10000000:01000000:3.0:1790779297.899361:0:17143:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1790779297.899522:0:21325:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.103@tcp: client import never connected 00000100:00080000:0.0:1790779297.899526:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1790779297.899528:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790779297.899530:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1790779297.899539:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790779297.899593:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790779297.899598:0:21325:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.103@tcp (uuid f89954ec-b1b4-4b66-a198-81b81a38f825) 00000020:01000000:0.0:1790779297.899605:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790779297.899608:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790779297.899612:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790779297.899616:0:21325:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b7603416800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790779297.899622:0:21325:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9b7602648000) has exports, disconnecting them 00000020:00080000:0.0:1790779297.899626:0:21325:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b7603416800), last request at 1790779227 00000020:00000080:0.0:1790779297.899631:0:21325:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e047 00000020:00080000:0.0:1790779297.899645:0:21325:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b7603416800): rc 0 00000020:00000080:0.0:1790779297.899649:0:21325:0:(genops.c:885:class_export_put()) final put ffff9b7603416800/lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790779297.906960:0:21325:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790779297.906969:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790779297.906974:0:21325:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790779297.906989:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790779297.907314:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779297.907323:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1790779297.907332:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790779297.907336:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779297.907340:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790779297.907347:0:21325:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9b7603414800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790779297.907354:0:21325:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9b76026499c0) has exports, disconnecting them 00000020:00080000:2.0:1790779297.907358:0:21325:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9b7603414800), last request at 1790779227 00000020:00000080:2.0:1790779297.907363:0:21325:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e05c 00000020:00080000:2.0:1790779297.907378:0:21325:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b7603414800): rc 0 00000020:00000080:2.0:1790779297.907384:0:21325:0:(genops.c:885:class_export_put()) final put ffff9b7603414800/lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1790779297.909059:0:21325:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790779297.909076:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790779297.909080:0:21325:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790779297.909087:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790779297.909282:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779297.909291:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1790779297.909297:0:21325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b773424c000 1 00000020:00000080:2.0:1790779297.909304:0:21325:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb1aa4014e936e001 00000020:00000080:2.0:1790779297.909312:0:21325:0:(genops.c:885:class_export_put()) final put ffff9b773424b000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1790779297.909319:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1790779297.909323:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779297.909328:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790779297.909331:0:21325:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9b7734098000) has no exports 00000020:00000080:2.0:1790779297.913938:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603bda800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790779297.914135:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b760322d800/f89954ec-b1b4-4b66-a198-81b81a38f825 for MGC192.168.203.103@tcp 00000020:00000080:2.0:1790779297.914154:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b770ea17000 for MGC192.168.203.103@tcp 00000020:00000080:2.0:1790779297.914163:0:36:0:(genops.c:885:class_export_put()) final put ffff9b770ea10800/f89954ec-b1b4-4b66-a198-81b81a38f825 00000020:00000080:2.0:1790779297.914166:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b770ea10800/f89954ec-b1b4-4b66-a198-81b81a38f825 for MGC192.168.203.103@tcp 00000020:01000000:2.0:1790779297.914171:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.103@tcp (f89954ec-b1b4-4b66-a198-81b81a38f825) 00010000:00010000:2.0:1790779297.914461:0:20173:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1790779297.915438:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1790779297.915640:0:17135:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1790779297.915732:0:17129:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b7702cbe600:17129] 0 exiting: rc = 1 00000100:00100000:0.0:1790779297.920135:0:17130:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b7702cbfe00:17130] 1 exiting: rc = 0 00000100:00100000:0.0:1790779297.920399:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.920752:0:20633:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b7602668800:20633] 3 exiting: rc = 0 00000100:00100000:0.0:1790779297.920812:0:17131:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b77182fe600:17131] 0 exiting: rc = 1 00000100:00100000:0.0:1790779297.920867:0:17133:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b77182ff600:17133] 2 exiting: rc = 0 00000100:00100000:2.0:1790779297.925078:0:17132:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b77182fee00:17132] 1 exiting: rc = 0 00000100:00100000:0.0:1790779297.925275:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925285:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925291:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925297:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925304:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925311:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925316:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925321:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925326:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925331:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925336:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925340:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925345:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925350:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925368:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925374:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925379:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925384:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925390:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925396:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925401:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925405:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925410:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925415:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925421:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925427:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925432:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925437:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925442:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925448:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925454:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925459:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925464:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925469:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925475:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925481:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925486:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925491:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925496:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925501:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925506:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925512:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925517:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925521:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925525:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925530:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925535:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925539:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925544:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925568:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925574:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925579:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925595:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925600:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925605:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925610:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925616:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925621:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925626:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925631:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925636:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925641:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925647:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.925652:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1790779297.927508:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603416800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790779297.927521:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7720129800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790779297.927529:0:36:0:(genops.c:885:class_export_put()) final put ffff9b772012e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1790779297.927532:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b772012e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1790779297.927536:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1790779297.927699:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603414800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1790779297.927706:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b7603411800 for lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1790779297.927710:0:36:0:(genops.c:885:class_export_put()) final put ffff9b7603410000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1790779297.927712:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b7603410000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1790779297.927715:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1790779297.927734:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773424b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790779297.966748:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779297.966762:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1790779297.966767:0:21325:0:(genops.c:885:class_export_put()) final put ffff9b773424b800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1790779297.966772:0:21325:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773424b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790779297.966785:0:21325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1790779297.968825:0:21325:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b773424c800 00000020:01000000:2.0:1790779297.968861:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1790779297.969692:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790779297.969702:0:21325:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790779297.969708:0:21325:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9b774116cd40) has no exports 00000020:00000080:2.0:1790779297.969765:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790779297.969774:0:21325:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1790779297.969779:0:21325:0:(genops.c:885:class_export_put()) final put ffff9b773b6d0800/OSS_uuid 00000020:00000080:2.0:1790779297.969784:0:21325:0:(genops.c:844:class_export_destroy()) destroying export ffff9b773b6d0800/OSS_uuid for OSS 00000020:01000000:2.0:1790779297.969790:0:21325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1790779297.972372:0:19170:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff9b76030e8800:19170] 3 exiting: rc = 0 00000100:00080000:3.0:1790779297.974342:0:17142:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1790779297.974534:0:18654:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff9b7741161a00:18654] 2 exiting: rc = 0 00000100:00100000:3.0:1790779297.974726:0:18653:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff9b773ae7e400:18653] 1 exiting: rc = 0 00000100:00100000:2.0:1790779297.975457:0:18652:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff9b773f4f1400:18652] 0 exiting: rc = 1 00000100:00100000:1.0:1790779297.982369:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982380:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982385:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982391:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982396:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982401:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982406:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982411:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982416:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982420:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982425:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982430:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982436:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982441:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982446:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982452:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982457:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982461:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982466:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982471:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982476:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982480:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982485:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982490:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982495:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982499:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982504:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982510:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982514:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982534:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982539:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982545:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982669:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982678:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982683:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982688:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982694:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982699:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982704:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982709:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982713:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982718:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982723:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982746:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982752:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982756:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982762:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982767:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982772:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982777:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982782:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982787:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982792:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982797:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982802:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982806:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982811:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982816:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982821:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982826:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982831:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982835:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982840:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.982845:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.984171:0:18656:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b77342b0600:18656] 1 exiting: rc = 0 00000100:00100000:2.0:1790779297.987404:0:18655:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b77342b0e00:18655] 0 exiting: rc = 1 00000100:00100000:1.0:1790779297.990176:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990188:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990194:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990199:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990204:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990209:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990215:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990222:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990238:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990247:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990253:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990260:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990266:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990272:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990277:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990284:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990290:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990295:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990301:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990307:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990314:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990320:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990325:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990331:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990336:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990342:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990347:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990354:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990358:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990363:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990367:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990372:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990377:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990382:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990387:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990410:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990415:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990420:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990426:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990431:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990436:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990441:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990447:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990453:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990458:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990464:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990469:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990474:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990479:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990484:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990489:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990494:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990499:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990504:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990509:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990515:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990520:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990525:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990531:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990537:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990542:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990547:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990552:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.990558:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790779297.992469:0:18658:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b7736d17a00:18658] 1 exiting: rc = 0 00000100:00100000:1.0:1790779297.992715:0:18657:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b773accd200:18657] 0 exiting: rc = 1 00000100:00100000:3.0:1790779297.994360:0:18659:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b7736e2ac00:18659] 2 exiting: rc = 0 00000100:00100000:2.0:1790779297.995704:0:20287:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9b7741d70c00:20287] 3 exiting: rc = 0 00000100:00100000:1.0:1790779297.996436:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996444:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996467:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996474:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996482:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996501:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996508:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996515:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996523:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996533:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996540:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996548:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996554:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996562:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996567:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996573:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996579:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996644:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996651:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996656:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996662:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996668:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996673:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996680:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996686:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996691:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996709:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996715:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996721:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996726:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996732:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996738:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996744:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996749:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996755:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996760:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996766:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996771:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996776:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996782:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996792:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996798:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996804:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996810:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996815:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996821:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996826:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996832:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996837:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996842:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996858:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996863:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996869:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.996874:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.997390:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.997400:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.997405:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.997411:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.997416:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.997422:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.997436:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.997448:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.997455:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790779297.997462:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.002606:0:18660:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b7705f9d400:18660] 0 exiting: rc = 1 00000100:00100000:0.0:1790779298.002615:0:18661:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b7705f9ce00:18661] 1 exiting: rc = 0 00000100:00100000:2.0:1790779298.002749:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002757:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002763:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002768:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002774:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002779:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002784:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002790:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002795:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002851:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002857:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002864:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002869:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.002875:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003218:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003224:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003228:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003300:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003307:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003313:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003319:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003325:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003345:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003350:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003355:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003360:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003365:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003370:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003376:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003382:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003387:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003392:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003396:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003401:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003407:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003413:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003418:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003424:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003429:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003434:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003439:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003445:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003450:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003456:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003462:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003467:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003472:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003477:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003482:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003488:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003493:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003498:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003503:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003508:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003513:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003518:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003523:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003536:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003542:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003547:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003552:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003557:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003562:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790779298.003568:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.004792:0:18663:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b7736d17000:18663] 1 exiting: rc = 0 00000100:00100000:1.0:1790779298.004923:0:18662:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b7736d16200:18662] 0 exiting: rc = 1 00000100:00100000:3.0:1790779298.005024:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005039:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005046:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005053:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005060:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005079:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005087:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005095:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005101:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005107:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005131:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005149:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005156:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005162:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005168:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005173:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005179:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005185:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005190:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005197:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005203:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005209:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005228:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005246:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005252:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005258:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005264:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005270:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005275:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005280:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005287:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005304:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005309:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005315:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005335:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005342:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005349:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005354:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005360:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005366:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005374:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005380:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005387:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005392:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005398:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005404:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005423:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005430:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005436:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005441:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005448:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005454:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005460:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005466:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005472:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005478:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005484:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005490:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005508:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005516:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005521:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005527:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005534:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790779298.005545:0:21325:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1790779298.014823:0:21325:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1790779318.523590:0:22089:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790779328.676034:0:22690:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790779328.676048:0:22690:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1790779328.676050:0:22690:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1790779328.676155:0:22690:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b773c016000 00000020:01000004:0.0:1790779328.676217:0:22690:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1790779328.676224:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790779328.676238:0:22690:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b76026499c0) 00000020:00000080:0.0:1790779328.676250:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790779328.775384:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790779328.776241:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1790779328.782064:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1790779328.786588:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1790779328.788966:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1790779328.790726:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1790779328.791176:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790779328.791427:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1790779328.792119:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1790779328.792870:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1790779328.793173:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1790779328.793568:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1790779328.794688:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1790779328.795131:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1790779328.795374:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790779328.798203:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1790779328.799095:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1790779328.799941:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1790779328.800273:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1790779328.800644:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1790779328.801609:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1790779328.802432:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1790779328.802985:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1790779328.803367:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1790779328.803865:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1790779328.804243:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1790779328.804694:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1790779328.805184:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1790779328.805456:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1790779328.806611:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1790779328.808573:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1790779328.809309:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1790779328.810498:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1790779328.811005:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1790779328.811269:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1790779328.811764:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1790779328.812083:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1790779328.812290:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1790779328.813605:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1790779328.814165:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1790779328.814400:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1790779328.814873:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1790779328.816087:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1790779328.816667:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1790779328.818047:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1790779328.818556:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1790779328.818935:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1790779328.822245:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1790779328.823170:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1790779328.823393:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1790779328.824188:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1790779328.824463:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1790779328.824863:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:0.0:1790779328.825372:0:22690:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790779328.825870:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1790779328.825916:0:22690:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790779328.825928:0:22690:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936e4b5 00000020:01000004:0.0:1790779328.825935:0:22690:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1790779328.825939:0:22690:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1790779328.825944:0:22690:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b773c016000 from MGS 00000020:01000004:0.0:1790779328.825948:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1790779328.825958:0:22690:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b7602648000) 00000020:00000080:0.0:1790779328.825968:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1790779328.826025:0:22690:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b773c016000 from MGS, refs=2 00080000:01000000:0.0:1790779328.826030:0:22690:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790779328.826035:0:22690:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936e4c3 00000100:00100000:0.0:1790779328.826127:0:22690:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790779328.826249:0:22690:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790779328.826254:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790779328.834621:0:22690:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1790779328.837239:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790779328.854017:0:22690:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779328.854215:0:22690:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790779328.854222:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790779328.863074:0:22690:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790779328.863090:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790779328.863905:0:22690:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790779328.863915:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790779328.871137:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779328.871144:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779328.871146:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779328.872617:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779328.872622:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779328.872624:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779328.873968:0:22690:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790779328.879648:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790779328.889407:0:22690:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1790779328.891010:0:22702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790779328.891073:0:22690:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790779328.891117:0:22690:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790779328.892020:0:22690:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790779328.892333:0:22690:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779328.892614:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790779328.892620:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790779328.893424:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790779328.893431:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790779328.893908:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790779328.893915:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790779328.897195:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790779328.897219:0:22690:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.103@tcp' 00000020:01000004:2.0:1790779328.897227:0:22690:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790779328.897255:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.103@tcp (typ=mgc) 00000020:00000080:2.0:1790779328.897270:0:22690:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.103@tcp (ffff9b7734098000) 00000020:00000080:2.0:1790779328.897287:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:1.0:1790779328.897436:0:22706:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:2.0:1790779328.897571:0:22690:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7704181000@MGC192.168.203.103@tcp: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1790779328.897730:0:22690:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.103@tcp-0 is initialized 00000040:01000000:2.0:1790779328.897736:0:22690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 1 is initialized 10000000:01000000:1.0:1790779328.898948:0:22707:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790779328.899016:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.103@tcp (uuid e9d73c52-009d-4820-b396-7792bc096088) 00000020:00000080:2.0:1790779328.899033:0:22690:0:(genops.c:1384:class_connect()) connect: client e9d73c52-009d-4820-b396-7792bc096088, cookie 0xb1aa4014e936e4d1 00000100:00080000:2.0:1790779328.899044:0:22690:0:(import.c:545:import_select_connection()) MGC192.168.203.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790779328.899053:0:22690:0:(import.c:666:import_select_connection()) MGC192.168.203.103@tcp: import ffff9b7704181000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779328.899085:0:22690:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7735c16680 x1877767663875072/t0(0) o250->MGC192.168.203.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779328.899110:0:22690:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e9d73c52-009d-4820-b396-7792bc096088->MGS 00000020:01000004:2.0:1790779328.899133:0:22690:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790779328.899137:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790779328.899149:0:22690:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b773409cd40) 00000020:00000080:2.0:1790779328.899159:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790779328.899992:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e9d73c52-009d-4820-b396-7792bc096088:3648:1877767663875072:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790779328.900063:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779328.900171:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663875072 00000100:00100000:1.0:1790779328.900179:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663875072 00000100:00100000:1.0:1790779328.900215:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790779328.900223:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3648:x1877767663875072:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1790779328.900248:0:22703:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e9d73c52-009d-4820-b396-7792bc096088@0@lo t0 exp 0000000000000000 cur 646 last 0 00000020:00000080:1.0:1790779328.900270:0:22703:0:(genops.c:1384:class_connect()) connect: client e9d73c52-009d-4820-b396-7792bc096088, cookie 0xb1aa4014e936e4df 00000100:00080000:1.0:1790779328.900414:0:22703:0:(import.c:65:import_set_state_nolock()) ffff9b7603876800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790779328.900469:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+5:3648:x1877767663875072:12345-0@lo:250:mount.lustre.0 Request processed in 245us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779328.900478:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790779328.900919:0:3648:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790779328.900940:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.103@tcp: connect to target with instance 0 00000100:00080000:0.0:1790779328.900948:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790779328.900952:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790779328.900956:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7704181000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790779328.900958:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790779328.900967:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790779328.900973:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e9d73c52-009d-4820-b396-7792bc096088:3648:1877767663875072:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790779328.935235:0:22690:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779328.935586:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790779328.935595:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790779328.939517:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790779328.939538:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790779328.940224:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790779328.940231:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790779328.947591:0:22690:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790779328.949283:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790779328.949289:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790779328.960496:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1790779328.960515:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790779329.029261:0:22690:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790779329.029521:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790779329.029529:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790779329.030862:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790779329.030875:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790779329.031566:0:22690:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779329.031769:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790779329.031774:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1790779329.033434:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790779329.033447:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1790779329.034074:0:22690:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779329.034242:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790779329.034247:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790779329.035181:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790779329.035191:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790779329.037232:0:22690:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779329.037456:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790779329.037463:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790779329.038084:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790779329.038091:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790779329.054157:0:22690:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779329.054431:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790779329.054444:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1790779329.055654:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790779329.055665:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790779329.056394:0:22690:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790779329.056402:0:22690:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1790779329.057158:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790779329.057188:0:22690:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1790779329.057194:0:22690:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790779329.057298:0:22690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790779329.057421:0:22690:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1790779329.057425:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790779329.057427:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790779329.057429:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790779329.057430:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790779329.057431:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790779329.057432:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790779329.057433:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790779329.057435:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790779329.057437:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790779329.057438:0:22690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790779329.057441:0:22690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1790779329.057443:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790779329.057444:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790779329.057445:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790779329.057446:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790779329.057447:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790779329.057449:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790779329.057450:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790779329.057450:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790779329.057451:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790779329.057452:0:22690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790779329.057476:0:22690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790779329.057495:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875200:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790779329.057565:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779329.057663:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81480 going to sleep for 11 seconds 00000100:00100000:0.0:1790779329.057716:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663875200 00000100:00100000:0.0:1790779329.057723:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663875200 00000100:00100000:0.0:1790779329.057798:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790779329.057808:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+5:22690:x1877767663875200:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790779329.057853:0:22705:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790779329.057856:0:22705:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790779329.057859:0:22705:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1790779329.058456:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790779329.059088:0:22705:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1790779329.060215:0:22728:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790779329.060227:0:22728:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1790779329.060230:0:22728:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790779329.060233:0:22728:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790779329.060420:0:22728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1790779329.060604:0:22705:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790779329.060614:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790779329.062213:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+5:22690:x1877767663875200:12345-0@lo:253:mount.lustre.0 Request processed in 4401us (4642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779329.062229:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790779329.062306:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875200:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790779329.062386:0:22690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790779329.062390:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790779329.062392:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790779329.062394:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790779329.062395:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790779329.062396:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790779329.062397:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790779329.062399:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790779329.062400:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790779329.062402:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790779329.062403:0:22690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790779329.062423:0:22690:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b773c016000 from lustre-MDT0000 10000000:01000000:1.0:1790779329.062453:0:22690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790779329.062456:0:22690:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790779329.062460:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b7734098000 10000000:01000000:1.0:1790779329.062464:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790779329.062472:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b7734098000 from 1 10000000:01000000:1.0:1790779329.062475:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790779329.062515:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.062527:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.062536:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779329.062555:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779329.062603:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779329.062680:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779329.062715:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663875328 00000100:00100000:0.0:1790779329.062721:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663875328 00000100:00100000:0.0:1790779329.062786:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790779329.062795:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+5:22690:x1877767663875328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779329.062808:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779329.062822:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76034af400/0xb1aa4014e936e4ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e4e6 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.062846:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76034af400/0xb1aa4014e936e4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e4e6 expref: 6 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.062856:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76034af400/0xb1aa4014e936e4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e4e6 expref: 6 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.062876:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034af400, rc 0) 00000100:00100000:0.0:1790779329.062950:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+6:22690:x1877767663875328:12345-0@lo:101:mount.lustre.0 Request processed in 156us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779329.062956:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779329.063019:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779329.063031:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.063047:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779329.063098:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779329.063124:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779329.063456:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663875456 00000100:00100000:1.0:1790779329.063462:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663875456 00000100:00100000:1.0:1790779329.063485:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790779329.063493:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+6:22690:x1877767663875456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779329.063561:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+6:22690:x1877767663875456:12345-0@lo:501:mount.lustre.0 Request processed in 69us (436us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790779329.063568:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790779329.063673:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773454f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779329.063693:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875456:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790779329.063726:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790779329.063775:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.063784:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779329.063792:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b773c016000 10000000:01000000:3.0:1790779329.063797:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790779329.063801:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b773c016000 10000000:01000000:3.0:1790779329.063804:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790779329.063807:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b773c016000 from 1 10000000:01000000:3.0:1790779329.063809:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790779329.063829:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894a800/0xb1aa4014e936e4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.063835:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894a800/0xb1aa4014e936e4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.063842:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894a800/0xb1aa4014e936e4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779329.063854:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790779329.063916:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779329.063949:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779329.064002:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663875584 00000100:00100000:0.0:1790779329.064006:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663875584 00000100:00100000:0.0:1790779329.064032:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790779329.064039:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+6:22690:x1877767663875584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779329.064047:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779329.064058:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76034ae800/0xb1aa4014e936e4fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e4f4 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.064075:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76034ae800/0xb1aa4014e936e4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e4f4 expref: 7 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.064084:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76034ae800/0xb1aa4014e936e4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e4f4 expref: 7 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.064092:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034ae800, rc 0) 00000100:00100000:0.0:1790779329.064133:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+7:22690:x1877767663875584:12345-0@lo:101:mount.lustre.0 Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779329.064139:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790779329.064208:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779329.064220:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894a800/0xb1aa4014e936e4f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4fb expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.064239:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894a800/0xb1aa4014e936e4f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e4fb expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779329.064252:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790779329.064511:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894a800/0xb1aa4014e936e4f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4fb expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.064519:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894a800/0xb1aa4014e936e4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4fb expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779329.064525:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790779329.064530:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790779329.064535:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b773c016000 10000000:01000000:3.0:1790779329.064537:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790779329.064540:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790779329.064542:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790779329.064557:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936e502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.064564:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936e502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.064572:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936e502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779329.064584:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790779329.064611:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779329.064636:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779329.064687:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663875712 00000100:00100000:2.0:1790779329.064692:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663875712 00000100:00100000:2.0:1790779329.064727:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790779329.064735:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+7:22690:x1877767663875712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779329.064742:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779329.064752:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7602671a00/0xb1aa4014e936e509 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e502 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.064766:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7602671a00/0xb1aa4014e936e509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e502 expref: 8 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.064774:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7602671a00/0xb1aa4014e936e509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e502 expref: 8 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.064780:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602671a00, rc 0) 00000100:00100000:2.0:1790779329.064815:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+8:22690:x1877767663875712:12345-0@lo:101:mount.lustre.0 Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779329.064822:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779329.064978:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779329.064989:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936e502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e509 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.064995:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936e502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e509 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779329.065045:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779329.065069:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779329.065089:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779329.065136:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663875840 00000100:00100000:0.0:1790779329.065141:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663875840 00000100:00100000:0.0:1790779329.065173:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790779329.065180:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+8:22690:x1877767663875840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779329.065300:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+9:22690:x1877767663875840:12345-0@lo:501:mount.lustre.0 Request processed in 120us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779329.065313:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779329.065442:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779329.065468:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779329.065505:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779329.065527:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779329.065541:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663875968 00000100:00100000:3.0:1790779329.065545:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663875968 00000100:00100000:3.0:1790779329.065566:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790779329.065572:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+9:22690:x1877767663875968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779329.066218:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+9:22690:x1877767663875968:12345-0@lo:503:mount.lustre.0 Request processed in 645us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779329.066225:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779329.066309:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663875968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779329.066757:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22729:1877767663876096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779329.066792:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779329.066824:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790779329.066867:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663876096 00000100:00100000:0.0:1790779329.066872:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663876096 00000100:00100000:0.0:1790779329.066936:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790779329.066943:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+9:22729:x1877767663876096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779329.067529:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+9:22729:x1877767663876096:12345-0@lo:502:llog_process_th.0 Request processed in 585us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779329.067536:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790779329.067619:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22729:1877767663876096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790779329.067650:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779329.067661:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.067663:0:22729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790779329.067668:0:22729:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790779329.067671:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790779329.067688:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b773059cd40) 00000020:00000080:3.0:1790779329.067706:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790779329.067712:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790779329.067801:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790779329.067811:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936e517 00000020:00000080:3.0:1790779329.068041:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790779329.068046:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779329.068049:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.068051:0:22729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790779329.068054:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779329.068057:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.068059:0:22729:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790779329.068062:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790779329.068069:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b7730598000) 00000020:00000080:3.0:1790779329.068080:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790779329.068085:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790779329.068087:0:22729:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790779329.068090:0:22729:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790779329.068096:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790779329.068140:0:22729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b773c016000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790779329.068152:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b77305999c0) 00000020:00000080:3.0:1790779329.068161:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790779329.068210:0:22729:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790779329.068215:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936e52c 00000020:00000080:3.0:1790779329.068297:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790779329.068302:0:22729:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790779329.068306:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb1aa4014e936e533 00080000:01000000:3.0:1790779329.068316:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790779329.068319:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936e53a 00010000:00010000:2.0:1790779329.134132:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790779329.135265:0:22729:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1790779329.136532:0:22729:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790779329.137776:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b773409b380) 00000020:00000080:2.0:1790779329.139866:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790779329.139973:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790779329.139982:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936e548 00000020:00000080:2.0:1790779329.153107:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790779329.156220:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb1aa4014e936e54f 00000020:00000080:2.0:1790779329.156777:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790779329.156789:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779329.156986:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779329.156989:0:22729:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790779329.156995:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790779329.156998:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1790779329.156999:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790779329.157001:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790779329.157003:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790779329.157006:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779329.157008:0:22729:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790779329.157010:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779329.157015:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779329.157017:0:22729:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790779329.157021:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790779329.157058:0:22729:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790779329.157073:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779329.157077:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779329.157078:0:22729:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790779329.157081:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779329.157085:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779329.157086:0:22729:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1790779329.157089:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790779329.157094:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:2.0:1790779329.157118:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790779329.157134:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9b77340999c0) 00000020:00000080:2.0:1790779329.157146:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1790779329.157151:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790779329.157218:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1790779329.157223:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790779329.157230:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936e55d 00010000:00080000:2.0:1790779329.157271:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b77041d3800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1790779329.160131:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1790779329.161133:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790779329.161148:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1790779329.161187:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790779329.161208:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936e564 00000100:00080000:3.0:1790779329.161219:0:22729:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790779329.161231:0:22729:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b77041d3800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779329.161272:0:22729:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603830700 x1877767663876224/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779329.161295:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1790779329.161408:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779329.161413:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.161415:0:22729:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1790779329.161418:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790779329.161421:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1790779329.161422:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790779329.161424:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790779329.161426:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790779329.161428:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.161430:0:22729:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790779329.161432:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790779329.161437:0:22729:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1790779329.161441:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.161442:0:22729:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790779329.161445:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790779329.161449:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:3.0:1790779329.161472:0:22729:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790779329.161475:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790779329.161489:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b773059b380) 00000020:00000080:3.0:1790779329.161499:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1790779329.161515:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790779329.161572:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790779329.161578:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790779329.161584:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936e572 00010000:00080000:3.0:1790779329.161613:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7711c96000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1790779329.161957:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1790779329.162396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663876224:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790779329.162476:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779329.162552:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663876224 00000100:00100000:0.0:1790779329.162560:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663876224 00000100:00100000:0.0:1790779329.162591:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790779329.162600:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663876224:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1790779329.162630:0:22716:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1790779329.166464:0:22729:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790779329.166754:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790779329.168555:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779329.169742:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1790779329.179530:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1790779329.181942:0:22735:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790779329.181949:0:22735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1790779329.183521:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663876224:12345-0@lo:38:llog_process_th.0 Request processed in 20915us (21038us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790779329.183537:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1790779329.183563:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77041d3800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779329.183571:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790779329.183576:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663876224:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1790779329.184723:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790779329.184742:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790779329.184787:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790779329.185004:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936e579 00000100:00080000:1.0:1790779329.185014:0:22729:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790779329.185023:0:22729:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b7711c96000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779329.185056:0:22729:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603744380 x1877767663876352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790779329.185139:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663876352:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790779329.185185:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663876352 offset 0 length 520: 4 00000100:00080000:1.0:1790779329.185236:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790779329.185338:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779329.185343:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779329.185345:0:22729:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790779329.185358:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790779329.185361:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1790779329.185363:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779329.185378:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779329.185380:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790779329.185383:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779329.185385:0:22729:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790779329.185388:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790779329.185392:0:22729:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1790779329.185395:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779329.185397:0:22729:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790779329.185400:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790779329.185404:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:1.0:1790779329.185423:0:22729:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790779329.185426:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779329.185437:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b774116b380) 00000020:00000080:1.0:1790779329.185449:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1790779329.185453:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790779329.185524:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790779329.185531:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:1.0:1790779329.185537:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1aa4014e936e587 00010000:00080000:1.0:1790779329.185573:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7741db3000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1790779329.185802:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1790779329.185917:0:22729:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790779329.185933:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790779329.188274:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779329.190572:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1790779329.190718:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1790779329.191392:0:22737:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790779329.191398:0:22737:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790779329.192614:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790779329.192696:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790779329.192735:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790779329.192752:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936e58e 00000100:00080000:1.0:1790779329.192763:0:22729:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790779329.192774:0:22729:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b7741db3000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779329.192989:0:22729:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603744000 x1877767663876480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790779329.193053:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663876480:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790779329.193105:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663876480 offset 0 length 520: 4 00000100:00080000:1.0:1790779329.193163:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790779329.193252:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779329.193257:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779329.193259:0:22729:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790779329.193262:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779329.193265:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779329.193266:0:22729:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790779329.193269:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790779329.193271:0:22729:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790779329.193274:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779329.193276:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779329.193277:0:22729:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790779329.193279:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779329.193282:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779329.193283:0:22729:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790779329.193287:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790779329.193316:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22729:1877767663876608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779329.193386:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779329.193422:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663876608 00000100:00100000:1.0:1790779329.193430:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663876608 00000100:00100000:1.0:1790779329.193468:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790779329.193478:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+9:22729:x1877767663876608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779329.193594:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+9:22729:x1877767663876608:12345-0@lo:502:llog_process_th.0 Request processed in 117us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779329.193601:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790779329.193652:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7701254c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779329.193670:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22729:1877767663876608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790779329.193692:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779329.193696:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779329.193697:0:22729:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790779329.193701:0:22729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1790779329.195981:0:22690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1790779329.196016:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790779329.196045:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936e502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e509 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.196059:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894aa00/0xb1aa4014e936e502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e509 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779329.196068:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b773c016000 from 1 10000000:01000000:1.0:1790779329.196072:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790779329.196119:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.196129:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.196141:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779329.196171:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663876736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779329.196248:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779329.196289:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7701254c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779329.196721:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663876736 00000100:00100000:0.0:1790779329.196742:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663876736 00000100:00100000:0.0:1790779329.197092:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790779329.197103:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+9:22690:x1877767663876736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779329.197116:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779329.197130:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e59c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e595 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.197187:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e595 expref: 10 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.197198:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e595 expref: 10 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.197206:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034afa00, rc 0) 00000100:00100000:0.0:1790779329.197263:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+10:22690:x1877767663876736:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779329.197269:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790779329.197358:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663876736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779329.197374:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.197383:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779329.197944:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663876864:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790779329.198025:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779329.198603:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773426d180 going to sleep for 11 seconds 00000100:00100000:1.0:1790779329.199080:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663876864 00000100:00100000:1.0:1790779329.199110:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663876864 00000100:00100000:1.0:1790779329.199147:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790779329.199157:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+10:22690:x1877767663876864:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790779329.199177:0:22705:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790779329.199184:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790779329.199263:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+10:22690:x1877767663876864:12345-0@lo:256:mount.lustre.0 Request processed in 108us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779329.199282:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779329.199672:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663876864:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790779329.200288:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790779329.200308:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.200330:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779329.200340:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b773c016000 from 1 10000000:01000000:2.0:1790779329.200343:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790779329.200399:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.200409:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.200419:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779329.200436:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663876992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779329.200471:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779329.200495:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773426d180 going to sleep for 11 seconds 00000100:00100000:1.0:1790779329.202516:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663876992 00000100:00100000:1.0:1790779329.202530:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663876992 00000100:00100000:1.0:1790779329.202581:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790779329.202591:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+10:22690:x1877767663876992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779329.202607:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779329.202638:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e5aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e5a3 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.202664:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e5a3 expref: 11 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.202675:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e5a3 expref: 11 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.202684:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6c00, rc 0) 00000100:00100000:1.0:1790779329.202748:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+11:22690:x1877767663876992:12345-0@lo:101:mount.lustre.0 Request processed in 158us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779329.202754:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790779329.203513:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663876992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779329.203533:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.203544:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779329.203864:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663877120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779329.203938:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779329.203971:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773426d180 going to sleep for 11 seconds 00000100:00100000:1.0:1790779329.204051:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663877120 00000100:00100000:1.0:1790779329.204056:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663877120 00000100:00100000:1.0:1790779329.204084:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790779329.204092:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+11:22690:x1877767663877120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779329.204233:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+11:22690:x1877767663877120:12345-0@lo:501:mount.lustre.0 Request processed in 141us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779329.204240:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790779329.204728:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663877120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779329.204760:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663877248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779329.204920:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779329.204943:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773426d180 going to sleep for 11 seconds 00000100:00100000:1.0:1790779329.205067:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663877248 00000100:00100000:1.0:1790779329.205079:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663877248 00000100:00100000:1.0:1790779329.205104:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790779329.205112:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+11:22690:x1877767663877248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779329.205217:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+11:22690:x1877767663877248:12345-0@lo:503:mount.lustre.0 Request processed in 106us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779329.205224:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790779329.205408:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663877248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779329.208738:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22739:1877767663877376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779329.208974:0:22739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779329.209062:0:22739:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711cd6000 going to sleep for 11 seconds 00000100:00100000:1.0:1790779329.209245:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663877376 00000100:00100000:1.0:1790779329.209254:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663877376 00000100:00100000:1.0:1790779329.209412:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790779329.209422:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+11:22739:x1877767663877376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790779329.210075:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+11:22739:x1877767663877376:12345-0@lo:502:llog_process_th.0 Request processed in 653us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779329.210084:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790779329.210238:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22739:1877767663877376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790779329.210298:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779329.210307:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.210310:0:22739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790779329.210317:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b773c016000 00000020:00000080:3.0:1790779329.210329:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779329.210337:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779329.210340:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.210342:0:22739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790779329.210344:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779329.210346:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.210347:0:22739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790779329.210361:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b773c016000 00000020:00000080:3.0:1790779329.210363:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779329.210423:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779329.210427:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.210428:0:22739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790779329.210438:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779329.210441:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.210442:0:22739:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790779329.210445:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b773c016000 00000020:00000080:3.0:1790779329.210447:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779329.210466:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779329.210469:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.210470:0:22739:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790779329.210472:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779329.210475:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779329.210477:0:22739:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790779329.210480:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b773c016000 00000020:00000080:3.0:1790779329.210482:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790779329.210520:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22739:1877767663877504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790779329.210559:0:22739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779329.217528:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663877504 00000100:00100000:0.0:1790779329.217541:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663877504 00000100:00100000:0.0:1790779329.217589:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790779329.217598:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+11:22739:x1877767663877504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779329.218004:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+11:22739:x1877767663877504:12345-0@lo:502:llog_process_th.0 Request processed in 407us (7444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779329.218037:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790779329.225148:0:22739:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779329.225190:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22739:1877767663877504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790779329.225230:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779329.225238:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779329.225241:0:22739:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790779329.225246:0:22739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1790779329.225929:0:22690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790779329.225953:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779329.225973:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.225985:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779329.226040:0:22690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790779329.226044:0:22690:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b773c016000 10000000:01000000:1.0:1790779329.226047:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b773c016000 10000000:01000000:1.0:1790779329.226051:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790779329.226057:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b773c016000 from 1 10000000:01000000:1.0:1790779329.226060:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790779329.226091:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6000/0xb1aa4014e936e5b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.226106:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be6000/0xb1aa4014e936e5b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.226115:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be6000/0xb1aa4014e936e5b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779329.226135:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663877632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779329.226192:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779329.226225:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77343d9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779329.226480:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663877632 00000100:00100000:0.0:1790779329.226494:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663877632 00000100:00100000:0.0:1790779329.226544:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790779329.226554:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+11:22690:x1877767663877632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779329.226566:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779329.226579:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76034aea00/0xb1aa4014e936e5b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e5b1 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.226601:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76034aea00/0xb1aa4014e936e5b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e5b1 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.226611:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76034aea00/0xb1aa4014e936e5b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e5b1 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779329.226725:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034aea00, rc 0) 00000100:00100000:0.0:1790779329.226781:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+12:22690:x1877767663877632:12345-0@lo:101:mount.lustre.0 Request processed in 228us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779329.226788:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790779329.227127:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663877632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779329.227142:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be6000/0xb1aa4014e936e5b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5b8 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.227151:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6000/0xb1aa4014e936e5b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e5b8 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779329.227208:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663877760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779329.227238:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779329.227252:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771190f300 going to sleep for 11 seconds 00000100:00100000:3.0:1790779329.229063:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663877760 00000100:00100000:3.0:1790779329.229076:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663877760 00000100:00100000:3.0:1790779329.229131:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790779329.229140:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+12:22690:x1877767663877760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779329.242751:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+12:22690:x1877767663877760:12345-0@lo:501:mount.lustre.0 Request processed in 13601us (15501us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779329.242766:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790779329.251905:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663877760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779329.251969:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663877888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779329.252034:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779329.252069:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771190f300 going to sleep for 11 seconds 00000100:00100000:0.0:1790779329.252276:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663877888 00000100:00100000:0.0:1790779329.252284:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663877888 00000100:00100000:0.0:1790779329.252346:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790779329.252364:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+12:22690:x1877767663877888:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779329.252480:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+12:22690:x1877767663877888:12345-0@lo:503:mount.lustre.0 Request processed in 117us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779329.252488:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790779329.253245:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663877888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779329.261222:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22745:1877767663878016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779329.261307:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779329.263454:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771190f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779329.268503:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663878016 00000100:00100000:3.0:1790779329.268517:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663878016 00000100:00100000:2.0:1790779329.268750:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790779329.268767:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+12:22745:x1877767663878016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779329.268974:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+12:22745:x1877767663878016:12345-0@lo:502:llog_process_th.0 Request processed in 208us (7666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779329.268983:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790779329.269200:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22745:1877767663878016:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1790779329.269262:0:22745:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790779329.269278:0:22745:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b77041ccd40) 00000020:00000080:3.0:1790779329.269298:0:22745:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1790779329.269439:0:22745:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b773c016000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790779329.269449:0:22745:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b773c016000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790779329.269452:0:22745:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b773c016000 4 00010000:00080000:3.0:1790779329.269484:0:22745:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b773b544800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1790779329.271164:0:22745:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1790779329.271384:0:22745:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790779329.271426:0:22745:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790779329.271440:0:22745:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb1aa4014e936e5c6 00000100:00080000:3.0:1790779329.271449:0:22745:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790779329.271459:0:22745:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b773b544800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779329.271492:0:22745:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603831180 x1877767663878144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779329.271518:0:22745:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790779329.272055:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663878144:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790779329.272125:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779329.273397:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22745:1877767663878272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779329.273452:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779329.273478:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663878272 00000100:00100000:2.0:1790779329.273485:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663878272 00000100:00100000:2.0:1790779329.273524:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790779329.273533:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+12:22745:x1877767663878272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779329.273639:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+12:22745:x1877767663878272:12345-0@lo:502:llog_process_th.0 Request processed in 106us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779329.273647:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790779329.273684:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771190f480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779329.273702:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22745:1877767663878272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779329.273739:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22745:1877767663878400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790779329.273769:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779329.273788:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771190f480 going to sleep for 11 seconds 00000100:00100000:0.0:1790779329.275532:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663878400 00000100:00100000:0.0:1790779329.275544:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663878400 00000100:00100000:0.0:1790779329.275592:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790779329.275602:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+12:22745:x1877767663878400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790779329.275766:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+12:22745:x1877767663878400:12345-0@lo:502:llog_process_th.0 Request processed in 165us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779329.275774:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790779329.276929:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e9d73c52-009d-4820-b396-7792bc096088:22745:1877767663878400:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790779329.276963:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:3.0:1790779329.278233:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663878144 00000100:00100000:3.0:1790779329.278242:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663878144 00000100:00100000:3.0:1790779329.278282:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790779329.278291:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663878144:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790779329.278702:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1877767663878144:12345-0@lo:38:llog_process_th.0 Request processed in 409us (6576us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790779329.278711:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1790779329.278735:0:22690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790779329.278760:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790779329.278773:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6000/0xb1aa4014e936e5b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5b8 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.278784:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be6000/0xb1aa4014e936e5b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5b8 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790779329.278851:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790779329.278854:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790779329.278859:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779329.278860:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779329.278861:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779329.278863:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779329.278864:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790779329.278865:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790779329.278867:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779329.278868:0:22690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790779329.278872:0:22690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1790779329.278874:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790779329.278875:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790779329.278876:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779329.278900:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779329.278901:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779329.278902:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779329.278903:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790779329.278904:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790779329.278905:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779329.278906:0:22690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790779329.280919:0:22690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790779329.280944:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663878528:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790779329.281005:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779329.281047:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f2480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779329.282023:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790779329.282033:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773b544800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779329.282038:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790779329.282041:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663878144:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790779329.282078:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663878528 00000100:00100000:2.0:1790779329.282084:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663878528 00000100:00100000:2.0:1790779329.282129:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790779329.282146:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+12:22690:x1877767663878528:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790779329.282173:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790779329.282186:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790779329.287583:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790779329.287631:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790779329.288145:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790779329.288151:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790779329.288175:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.288194:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e59c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e595 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.288204:0:22727:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.288245:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e595 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779329.288278:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e59c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e595 expref: 12 pid: 22703 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779329.288296:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663878656:0@lo:104: 00000100:00100000:3.0:1790779329.288428:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779329.288515:0:22727:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779329.288630:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+12:22690:x1877767663878528:12345-0@lo:253:mount.lustre.0 Request processed in 6484us (7624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779329.288642:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790779329.288744:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:22690:1877767663878528:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790779329.288756:0:22690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790779329.288759:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790779329.288761:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790779329.288762:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779329.288764:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779329.288765:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779329.288767:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779329.288768:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790779329.288769:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790779329.288771:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779329.288773:0:22690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790779329.288786:0:22690:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790779329.290037:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663878656 00000100:00100000:1.0:1790779329.290047:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663878656 00000100:00100000:1.0:1790779329.290099:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790779329.290109:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+3:22727:x1877767663878656:12345-0@lo:104: 00010000:00010000:1.0:1790779329.290123:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.290190:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790779329.290196:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+3:22727:x1877767663878656:12345-0@lo:104: Request processed in 90us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779329.290202:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790779329.290240:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663878656:0@lo:104: 00010000:00010000:1.0:1790779329.290279:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.290297:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779329.290312:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.290327:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7800 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779329.290332:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.290340:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779329.290355:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779329.290361:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790779329.290394:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.290401:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779329.290421:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.290429:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be7800/0xb1aa4014e936e595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e59c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.290444:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779329.290446:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779329.290447:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779329.290487:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779329.290498:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663878784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779329.290533:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779329.292085:0:22696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663878784 00000100:00100000:2.0:1790779329.292096:0:22696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663878784 00010000:00010000:2.0:1790779329.292125:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e59c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e595 expref: 12 pid: 22703 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779329.292157:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779329.292165:0:22696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+12:3651:x1877767663878784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779329.292178:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779329.292183:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e59c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e595 expref: 12 pid: 22703 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.292195:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e595 expref: 12 pid: 22703 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.292209:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e59c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e595 expref: 12 pid: 22703 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.292225:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.292234:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790779329.292261:0:22696:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004110832s 00010000:00010000:2.0:1790779329.292266:0:22696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.292274:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.292280:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.292286:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.292292:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894ac00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779329.292295:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.292302:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.292361:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779329.292373:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779329.292427:0:22696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+11:3651:x1877767663878784:12345-0@lo:103:ldlm_bl.0 Request processed in 262us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779329.292434:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790779329.292538:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.292554:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779329.292560:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e5cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779329.292598:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663878784:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1790779329.312611:0:22690:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1790779329.313020:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1790779329.313150:0:22750:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1790779329.313154:0:22750:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1790779329.313244:0:22751:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1790779329.313630:0:22751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1790779329.315436:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1790779329.316630:0:22752:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9b7603744a80 x1877767663878912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779329.316645:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00000040:01000000:2.0:1790779329.317095:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790779329.317169:0:22690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790779329.318132:0:22690:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790779329.318144:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790779329.318201:0:22690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790779329.318654:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790779329.318754:0:22751:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1790779329.321026:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790779329.321686:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790779329.321727:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790779329.323228:0:22690:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1790779329.324269:0:22690:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1790779329.330190:0:22690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1790779329.333191:0:22690:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790779329.333250:0:22690:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc92c1897988 00100000:10000000:2.0:1790779329.333260:0:22690:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790779329.334376:0:22690:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790779329.334398:0:22690:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790779329.334430:0:22690:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790779329.334463:0:22690:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1790779329.335439:0:22690:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790779329.335686:0:22690:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790779329.900084:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790779330.288283:0:22744:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790779330.288292:0:22744:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790779330.289699:0:22744:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790779330.289708:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790779330.344106:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 10000000:01000000:1.0:1790779330.535966:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790779330.535973:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b773c016000 from 11 10000000:01000000:1.0:1790779330.535977:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790779330.536023:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779330.536034:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779330.536045:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779330.536069:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663879040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779330.536140:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779330.536251:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7718764180 going to sleep for 11 seconds 00000100:00100000:0.0:1790779330.536322:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663879040 00000100:00100000:0.0:1790779330.536329:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663879040 00000100:00100000:0.0:1790779330.536479:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790779330.536489:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+11:22707:x1877767663879040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779330.536501:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779330.536514:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e5db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e5d4 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779330.536535:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e5db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e5d4 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779330.536545:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e5db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e5d4 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779330.536553:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034afa00, rc 0) 00000100:00100000:0.0:1790779330.536597:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+12:22707:x1877767663879040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779330.536604:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790779330.536673:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663879040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779330.536687:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779330.536695:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779330.536750:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663879168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790779330.536788:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779330.537103:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7718764180 going to sleep for 11 seconds 00000100:00100000:2.0:1790779330.537198:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663879168 00000100:00100000:2.0:1790779330.537203:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663879168 00000100:00100000:2.0:1790779330.537227:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790779330.537234:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+12:22707:x1877767663879168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790779330.537248:0:22704:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790779330.537265:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790779330.537268:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1790779330.537368:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+12:22707:x1877767663879168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779330.537375:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790779330.537455:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663879168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790779330.537491:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790779330.537497:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779330.537506:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779330.920286:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790779331.305262:0:22744:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790779331.305283:0:22744:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790779331.305422:0:22744:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1790779331.305528:0:22744:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790779331.305669:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1790779331.372846:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00010000:00010000:3.0:1790779331.957629:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779332.392876:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00010000:00010000:1.0:1790779332.968863:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779333.417534:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00000001:02000400:0.0:1790779333.775805:0:22994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790779333.996498:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779334.439993:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00000020:00000004:1.0:1790779334.618362:0:23046:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779334.618797:0:23046:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1790779334.760103:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790779334.760110:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790779334.760114:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b77041d3800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779334.760122:0:9333:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 647 00000100:00080000:1.0:1790779334.760137:0:9333:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790779334.760147:0:9333:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b77041d3800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779334.760168:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603745c00 x1877767663879424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790779334.760186:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779334.760190:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779334.760193:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779334.760196:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779334.760198:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790779334.760201:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790779334.760203:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b773b544800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779334.760207:0:9333:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b773b544800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779334.760216:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603744e00 x1877767663879552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779334.760247:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663879424:0@lo:38:kworker.0 00000100:00100000:1.0:1790779334.760351:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779334.760405:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663879552:0@lo:38:kworker.0 00000100:00100000:1.0:1790779334.760428:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779334.760469:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663879424 00000100:00100000:1.0:1790779334.760476:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663879424 00000100:00100000:1.0:1790779334.760503:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790779334.760510:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663879424:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790779334.760526:0:22717:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790779334.760568:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663879424:12345-0@lo:38:kworker.0 Request processed in 58us (217us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790779334.760575:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1790779334.760612:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77041d3800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779334.760616:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790779334.760620:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663879424:0@lo:38:kworker.0 00000100:00100000:2.0:1790779334.760808:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663879296:0@lo:400:kworker.0 00000100:00100000:2.0:1790779334.760840:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779334.760984:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663879552 00000100:00100000:3.0:1790779334.760989:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663879552 00000100:00100000:3.0:1790779334.761017:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790779334.761023:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663879552:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1790779334.761040:0:22713:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:3.0:1790779334.761077:0:22713:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb1aa4014e936e5e2 00000004:00100000:3.0:1790779334.761091:0:22713:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790779334.761213:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9b7603b13800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779334.761365:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1877767663879552:12345-0@lo:38:kworker.0 Request processed in 340us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779334.761371:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790779334.761674:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663879296 00000100:00100000:1.0:1790779334.761679:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663879296 00000100:00100000:1.0:1790779334.761718:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790779334.761725:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+12:3649:x1877767663879296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779334.761771:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+12:3649:x1877767663879296:12345-0@lo:400:kworker.0 Request processed in 47us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779334.761777:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1790779334.761948:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b7603744e00 x1877767663879552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790779334.761963:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1790779334.761972:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790779334.761976:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790779334.761978:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773b544800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790779334.761984:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1877767663879552:0@lo:38:kworker.0 00000100:00100000:3.0:1790779334.762189:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663879296:0@lo:400:kworker.0 00010000:00010000:1.0:1790779335.023094:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779335.469855:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00000020:00000004:2.0:1790779335.672000:0:23097:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779335.672178:0:23097:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790779336.040156:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779336.490093:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00010000:00010000:1.0:1790779337.064015:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779337.515372:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00010000:00010000:3.0:1790779338.094303:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779338.535945:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00010000:00010000:1.0:1790779339.112983:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779339.561078:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00000100:00100000:2.0:1790779339.880477:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779329/real 1790779329] req@ffff9b7603744000 x1877767663876480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779339 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779339.880539:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603744000 x1877767663876480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779339 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779339.880549:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779329/real 1790779329] req@ffff9b7603744380 x1877767663876352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779339 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779339.880561:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603744380 x1877767663876352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779339 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790779339.880577:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7741db3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779339.880599:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790779339.880604:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663876480:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790779339.880610:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7711c96000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779339.880625:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790779339.880629:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663876352:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790779339.880924:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790779339.880929:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790779339.880932:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b77041d3800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779339.880937:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:3.0:1790779339.880948:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790779339.880957:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b77041d3800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779339.880976:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603830e00 x1877767663879808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779339.880989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779339.880992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790779339.880993:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7711c96000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779339.880997:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 647 00000100:00080000:3.0:1790779339.880999:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790779339.881003:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b7711c96000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779339.881011:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603831500 x1877767663879936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779339.881019:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779339.881021:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790779339.881023:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7741db3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790779339.881025:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 647 00000100:00080000:3.0:1790779339.881028:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790779339.881031:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b7741db3000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779339.881038:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603833b80 x1877767663880064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779339.881071:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779339.881082:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663879680:0@lo:400:kworker.0 00000100:00100000:3.0:1790779339.881134:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779339.881188:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663879680 00000100:00100000:3.0:1790779339.881195:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663879680 00000100:00100000:3.0:1790779339.881236:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790779339.881244:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+12:3649:x1877767663879680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779339.881309:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+12:3649:x1877767663879680:12345-0@lo:400:kworker.0 Request processed in 65us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779339.881316:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790779339.881372:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663879680:0@lo:400:kworker.0 00000100:00100000:3.0:1790779339.881633:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663879808:0@lo:38:kworker.0 00000100:00100000:3.0:1790779339.881663:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779339.881683:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663879936:0@lo:8:kworker.0 00000400:00000100:3.0:1790779339.881703:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663879936 offset 0 length 520: 4 00000100:00100000:3.0:1790779339.881718:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663880064:0@lo:8:kworker.0 00000400:00000100:3.0:1790779339.881733:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663880064 offset 0 length 520: 4 00000100:00100000:0.0:1790779339.881990:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790779339.882000:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663880192:0@lo:400:kworker.0 00000100:00100000:0.0:1790779339.882032:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779339.882066:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663880192 00000100:00100000:0.0:1790779339.882070:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663880192 00000100:00100000:0.0:1790779339.882096:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790779339.882103:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663880192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779339.882136:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663880192:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779339.882143:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790779339.882169:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b7603832300 x1877767663880192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779339.882180:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663880192:0@lo:400:kworker.0 00000100:00100000:0.0:1790779339.882209:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663879808 00000100:00100000:0.0:1790779339.882212:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663879808 00000100:00100000:0.0:1790779339.882233:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790779339.882238:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663879808:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1790779339.882253:0:22717:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790779339.882299:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1877767663879808:12345-0@lo:38:kworker.0 Request processed in 59us (635us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790779339.882305:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1790779339.882328:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77041d3800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790779339.882332:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790779339.882335:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663879808:0@lo:38:kworker.0 00010000:00010000:3.0:1790779340.137053:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779340.585428:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00010000:00010000:3.0:1790779341.162182:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790779341.548329:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790779341.610381:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00010000:00010000:3.0:1790779342.185147:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779342.633293:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00000020:01000004:1.0:1790779343.087135:0:23443:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790779343.087140:0:23443:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1790779343.087141:0:23443:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1790779343.087261:0:23443:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b770ea1b000 00000020:01000004:1.0:1790779343.087277:0:23443:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1790779343.087289:0:23443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1790779343.087303:0:23443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9b77411699c0) 00000020:00000080:1.0:1790779343.087316:0:23443:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790779343.189423:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1790779343.190092:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1790779343.193904:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1790779343.194922:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1790779343.195380:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1790779343.195609:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1790779343.196785:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1790779343.197372:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1790779343.198474:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1790779343.198814:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.200828:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1790779343.201194:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.201468:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1790779343.202042:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.202897:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.203509:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1790779343.203777:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.204318:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.204524:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1790779343.205162:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.206998:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.209414:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00010000:00010000:3.0:1790779343.209739:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1790779343.216496:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1790779343.216972:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.217318:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.217589:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1790779343.222136:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1790779343.222596:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1790779343.222857:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.223466:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1790779343.223714:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1790779343.224007:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1790779343.224309:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1790779343.224547:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1790779343.229255:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1790779343.229978:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1790779343.230281:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1790779343.230601:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1790779343.230852:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1790779343.231569:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1790779343.231772:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1790779343.232242:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1790779343.232755:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1790779343.233063:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1790779343.233757:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1790779343.234083:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:0.0:1790779343.234820:0:23443:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790779343.235313:0:23443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1790779343.235326:0:23443:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790779343.235339:0:23443:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936e5f0 00000020:01000004:0.0:1790779343.235357:0:23443:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1790779343.235381:0:23443:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790779343.235384:0:23443:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790779343.235391:0:23443:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1790779343.235421:0:23443:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1790779343.235425:0:23443:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1790779343.254063:0:23443:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790779343.254526:0:23443:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1790779343.254531:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790779343.254533:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790779343.254535:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779343.254536:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779343.254537:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779343.254539:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779343.254540:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779343.254542:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779343.254543:0:23443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790779343.254546:0:23443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1790779343.254549:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790779343.254550:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790779343.254551:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779343.254552:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779343.254554:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779343.254555:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779343.254556:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790779343.254557:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779343.254558:0:23443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790779343.254584:0:23443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790779343.254603:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880320:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790779343.254677:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779343.254778:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771824d480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779343.257076:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663880320 00000100:00100000:2.0:1790779343.257089:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663880320 00000100:00100000:2.0:1790779343.257292:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790779343.257303:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+12:23443:x1877767663880320:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790779343.257343:0:22703:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790779343.257346:0:22703:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1790779343.257406:0:22703:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1790779343.259313:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+12:23443:x1877767663880320:12345-0@lo:253:mount.lustre.0 Request processed in 2005us (4628us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779343.259325:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790779343.259548:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880320:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790779343.259563:0:23443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790779343.259567:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790779343.259568:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790779343.259569:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790779343.259571:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790779343.259571:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790779343.259573:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790779343.259574:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790779343.259576:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790779343.259577:0:23443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790779343.259597:0:23443:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b770ea1b000 from lustre-MDT0001 10000000:01000000:1.0:1790779343.259627:0:23443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1790779343.259630:0:23443:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1790779343.259635:0:23443:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b7734098000 local copy 00010000:00010000:1.0:1790779343.259645:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779343.259741:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779343.259778:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779343.259814:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779343.260015:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663880448 00000100:00100000:0.0:1790779343.260022:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663880448 00000100:00100000:0.0:1790779343.260063:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790779343.260072:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+12:23443:x1877767663880448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779343.260150:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+12:23443:x1877767663880448:12345-0@lo:501:mount.lustre.0 Request processed in 79us (371us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790779343.260158:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790779343.260347:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880448:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790779343.260361:0:23443:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790779343.260376:0:23443:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790779343.260382:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779343.260399:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779343.260423:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b770ea1b000 10000000:01000000:1.0:1790779343.260428:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790779343.260433:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b7734098000 10000000:01000000:1.0:1790779343.260435:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790779343.260449:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b7734098000 from 1 10000000:01000000:1.0:1790779343.260452:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790779343.260475:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936e5f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779343.260483:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936e5f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779343.260492:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936e5f7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779343.260504:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779343.260527:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779343.260552:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779343.260654:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663880576 00000100:00100000:0.0:1790779343.260658:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663880576 00000100:00100000:0.0:1790779343.260689:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790779343.260695:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+12:23443:x1877767663880576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779343.260704:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779343.260717:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76034afc00/0xb1aa4014e936e5fe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e5f7 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.260736:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76034afc00/0xb1aa4014e936e5fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e5f7 expref: 13 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.260747:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76034afc00/0xb1aa4014e936e5fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e5f7 expref: 13 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.260756:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034afc00, rc 0) 00000100:00100000:0.0:1790779343.260797:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+13:23443:x1877767663880576:12345-0@lo:101:mount.lustre.0 Request processed in 101us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779343.260803:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790779343.261037:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880576:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779343.261050:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936e5f7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5fe expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.261071:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936e5f7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e5fe expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779343.261087:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1790779343.261104:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936e5f7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5fe expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.261112:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be6200/0xb1aa4014e936e5f7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e5fe expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779343.261288:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b770ea1b000 10000000:01000000:2.0:1790779343.261293:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790779343.261297:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b770ea1b000 from 1 10000000:01000000:2.0:1790779343.261299:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790779343.261316:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671800/0xb1aa4014e936e605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.261323:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7602671800/0xb1aa4014e936e605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.261331:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7602671800/0xb1aa4014e936e605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779343.261343:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779343.261372:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.261400:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c600 going to sleep for 11 seconds 00000100:00100000:0.0:1790779343.261504:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663880704 00000100:00100000:0.0:1790779343.261510:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663880704 00000100:00100000:0.0:1790779343.261542:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790779343.261549:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+13:23443:x1877767663880704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779343.261564:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779343.261573:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76034ae600/0xb1aa4014e936e60c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e605 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.261588:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76034ae600/0xb1aa4014e936e60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e605 expref: 14 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.261596:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76034ae600/0xb1aa4014e936e60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e605 expref: 14 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.261603:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034ae600, rc 0) 00000100:00100000:0.0:1790779343.261642:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+14:23443:x1877767663880704:12345-0@lo:101:mount.lustre.0 Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779343.261649:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790779343.261816:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779343.261827:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7602671800/0xb1aa4014e936e605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e60c expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.261842:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7602671800/0xb1aa4014e936e605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e60c expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779343.261853:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790779343.261868:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671800/0xb1aa4014e936e605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e60c expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.262011:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7602671800/0xb1aa4014e936e605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e60c expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779343.262020:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1790779343.262024:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790779343.262028:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b770ea1b000 10000000:01000000:2.0:1790779343.262031:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790779343.262035:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1790779343.262037:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790779343.262050:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671600/0xb1aa4014e936e613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.262056:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7602671600/0xb1aa4014e936e613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.262063:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7602671600/0xb1aa4014e936e613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779343.262074:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779343.262100:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.262171:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c600 going to sleep for 11 seconds 00000100:00100000:3.0:1790779343.268028:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663880832 00000100:00100000:3.0:1790779343.268047:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663880832 00000100:00100000:3.0:1790779343.268223:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790779343.268236:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+14:23443:x1877767663880832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779343.268265:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779343.268284:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894be00/0xb1aa4014e936e61a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e613 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779343.268335:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894be00/0xb1aa4014e936e61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e613 expref: 15 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779343.268347:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894be00/0xb1aa4014e936e61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e613 expref: 15 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779343.268356:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894be00, rc 0) 00000100:00100000:3.0:1790779343.268463:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+15:23443:x1877767663880832:12345-0@lo:101:mount.lustre.0 Request processed in 231us (6361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779343.268470:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790779343.268561:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779343.268580:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7602671600/0xb1aa4014e936e613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e61a expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.268590:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7602671600/0xb1aa4014e936e613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e61a expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779343.273582:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1790779343.274824:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790779343.290143:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1790779343.290200:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1790779343.291124:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1790779343.291156:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1790779343.291175:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1790779343.291191:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1790779343.291206:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1790779343.291295:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1790779343.291314:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1790779343.291329:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1790779343.291343:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1790779343.291355:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1790779343.291370:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1790779343.291383:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1790779343.291396:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1790779343.291410:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1790779343.291424:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1790779343.291437:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1790779343.292171:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1790779343.292183:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1790779343.292194:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1790779343.292206:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1790779343.292289:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1790779343.292319:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1790779343.292332:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1790779343.292343:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1790779343.292354:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1790779343.292368:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1790779343.292379:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1790779343.292391:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1790779343.292402:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1790779343.292412:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1790779343.292422:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1790779343.292432:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1790779343.294088:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1790779343.294125:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1790779343.294136:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1790779343.294147:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1790779343.294161:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1790779343.294172:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1790779343.294183:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1790779343.294194:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1790779343.294206:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1790779343.294219:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1790779343.297802:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1790779343.297828:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1790779343.297973:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779343.298038:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.298083:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1790779343.298187:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663880960 00000100:00100000:1.0:1790779343.298195:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663880960 00000100:00100000:1.0:1790779343.298253:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790779343.298264:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+15:23443:x1877767663880960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779343.298408:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+15:23443:x1877767663880960:12345-0@lo:501:mount.lustre.0 Request processed in 145us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779343.298416:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790779343.298769:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663880960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779343.298802:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663881088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779343.298842:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.298864:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779343.299039:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663881088 00000100:00100000:3.0:1790779343.299045:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663881088 00000100:00100000:3.0:1790779343.299080:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790779343.299087:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+15:23443:x1877767663881088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779343.299862:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+15:23443:x1877767663881088:12345-0@lo:503:mount.lustre.0 Request processed in 773us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779343.299871:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790779343.300190:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663881088:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790779343.300753:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790779343.300824:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663881216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779343.302206:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.302290:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c600 going to sleep for 11 seconds 00000100:00100000:0.0:1790779343.302344:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663881216 00000100:00100000:0.0:1790779343.302352:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663881216 00000100:00100000:0.0:1790779343.302400:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790779343.302409:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+15:23443:x1877767663881216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779343.306645:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+15:23443:x1877767663881216:12345-0@lo:502:mount.lustre.0 Request processed in 4230us (5762us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779343.306659:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790779343.306760:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663881216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790779343.307011:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790779343.307038:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1790779343.307050:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1790779343.307060:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1790779343.307071:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1790779343.307082:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1790779343.307092:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1790779343.307103:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1790779343.307114:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1790779343.307124:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1790779343.307135:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1790779343.307146:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1790779343.307156:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1790779343.307167:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1790779343.307178:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1790779343.307190:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1790779343.307201:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1790779343.307211:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1790779343.307226:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1790779343.307236:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1790779343.307261:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1790779343.307275:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1790779343.307287:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1790779343.307299:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1790779343.307319:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1790779343.307329:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1790779343.307340:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1790779343.307350:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1790779343.307361:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1790779343.307371:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1790779343.307383:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1790779343.307393:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1790779343.307404:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1790779343.307414:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1790779343.307425:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1790779343.307435:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1790779343.307456:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1790779343.307468:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1790779343.307479:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1790779343.307490:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1790779343.307500:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1790779343.307511:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1790779343.307522:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1790779343.307532:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1790779343.307565:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663881344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779343.307610:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.307638:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c600 going to sleep for 11 seconds 00000100:00100000:0.0:1790779343.311484:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663881344 00000100:00100000:0.0:1790779343.311497:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663881344 00000100:00100000:0.0:1790779343.311559:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790779343.311567:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+15:23443:x1877767663881344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779343.311729:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+15:23443:x1877767663881344:12345-0@lo:502:mount.lustre.0 Request processed in 162us (4118us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779343.311746:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790779343.312129:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663881344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790779343.312204:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1790779343.312224:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1790779343.313177:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779343.313187:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779343.313190:0:23447:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790779343.313196:0:23447:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1790779343.313198:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790779343.313219:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9b760264b380) 00000020:00000080:0.0:1790779343.313238:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1790779343.313253:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790779343.313322:0:23447:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790779343.313329:0:23447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936e628 00000020:00000080:0.0:1790779343.313557:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1790779343.313561:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779343.313564:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779343.313566:0:23447:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790779343.313569:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779343.313572:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779343.313573:0:23447:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1790779343.313576:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790779343.313583:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9b760264cd40) 00000020:00000080:0.0:1790779343.313594:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1790779343.313597:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790779343.313599:0:23447:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1790779343.313602:0:23447:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1790779343.313607:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790779343.313661:0:23447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b770ea1b000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1790779343.313681:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9b77274319c0) 00000020:00000080:0.0:1790779343.313692:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1790779343.313756:0:23447:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790779343.313762:0:23447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936e63d 00000020:00000080:0.0:1790779343.313848:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1790779343.313854:0:23447:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790779343.313863:0:23447:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb1aa4014e936e644 00080000:01000000:0.0:1790779343.313869:0:23447:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790779343.313873:0:23447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936e64b 00010000:00010000:2.0:1790779343.470745:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1790779343.473336:0:23447:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1790779343.474416:0:23447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790779343.484799:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1790779343.484813:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779343.484820:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779343.484822:0:23447:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1790779343.484826:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779343.484832:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779343.484833:0:23447:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1790779343.484837:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790779343.484842:0:23447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:00000080:1.0:1790779343.484870:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779343.485068:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9b774116cd40) 00000020:00000080:1.0:1790779343.485090:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1790779343.485098:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790779343.485549:0:23447:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1790779343.485557:0:23447:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790779343.485565:0:23447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936e659 00010000:00080000:1.0:1790779343.485598:0:23447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b77344a2000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1790779343.493140:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1790779343.498269:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790779343.498285:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790779343.498328:0:23447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790779343.498351:0:23447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936e660 00000100:00080000:1.0:1790779343.498362:0:23447:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790779343.498374:0:23447:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b77344a2000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779343.498411:0:23447:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603745c00 x1877767663881472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790779343.498453:0:23447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1790779343.498507:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779343.498511:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779343.498513:0:23447:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1790779343.498516:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790779343.498525:0:23447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1790779343.498527:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779343.498529:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779343.498530:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790779343.498533:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779343.498534:0:23447:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790779343.498536:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790779343.498540:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779343.498542:0:23447:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1790779343.498546:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790779343.498578:0:23447:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790779343.498592:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790779343.498595:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779343.498597:0:23447:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1790779343.498600:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790779343.498602:0:23447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1790779343.498603:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779343.498605:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790779343.498607:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790779343.498609:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779343.498610:0:23447:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790779343.498613:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790779343.498616:0:23447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1790779343.498620:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790779343.498621:0:23447:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790779343.498624:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790779343.498628:0:23447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:1.0:1790779343.498649:0:23447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1790779343.498652:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790779343.498664:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9b7741168000) 00000020:00000080:1.0:1790779343.498675:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1790779343.498679:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790779343.498744:0:23447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1790779343.498750:0:23447:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790779343.498760:0:23447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936e66e 00010000:00080000:1.0:1790779343.498794:0:23447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7603908000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.103@tcp at head 00000100:00080000:2.0:1790779343.499034:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790779343.499047:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790779343.499050:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b77041d3800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779343.499054:0:9333:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 657 00000100:00080000:2.0:1790779343.499058:0:9333:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790779343.499065:0:9333:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b77041d3800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779343.499082:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7735c15c00 x1877767663881600/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779343.499091:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779343.499094:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779343.499096:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779343.499098:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790779343.499140:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663881728:0@lo:400:kworker.0 00000100:00100000:2.0:1790779343.499198:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.499277:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663881728 00000100:00100000:2.0:1790779343.499284:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663881728 00000100:00100000:2.0:1790779343.499322:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779343.499331:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663881728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779343.499382:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663881728:12345-0@lo:400:kworker.0 Request processed in 51us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779343.499389:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790779343.499432:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b7735c17100 x1877767663881728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779343.499444:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663881728:0@lo:400:kworker.0 00000100:00100000:3.0:1790779343.499653:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663881472:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790779343.499688:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779343.499736:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663881600:0@lo:38:kworker.0 00000100:00100000:3.0:1790779343.499755:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779343.499786:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663881472 00000100:00100000:3.0:1790779343.499789:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663881472 00000100:00100000:3.0:1790779343.499801:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663881600 00000100:00100000:3.0:1790779343.499803:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663881600 00000100:00100000:3.0:1790779343.499812:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790779343.499823:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663881472:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790779343.499843:0:22716:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:3.0:1790779343.499872:0:22716:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936e675 00000004:00100000:3.0:1790779343.499909:0:22716:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790779343.499914:0:22716:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:1.0:1790779343.501683:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1790779343.506107:0:23447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790779343.506639:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1790779343.509606:0:22716:0:(import.c:65:import_set_state_nolock()) ffff9b77208af800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779343.509719:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1877767663881472:12345-0@lo:38:llog_process_th.0 Request processed in 9892us (10027us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779343.509729:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790779343.509757:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790779343.509763:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663881600:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1790779343.509806:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663881600:12345-0@lo:38:kworker.0 Request processed in 42us (10049us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790779343.509812:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790779343.509922:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790779343.509932:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1790779343.509940:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790779343.509945:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790779343.509948:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77344a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790779343.509961:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663881472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790779343.509975:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790779343.509979:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77041d3800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790779343.509983:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790779343.509986:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663881600:0@lo:38:kworker.0 00000100:00100000:1.0:1790779343.510240:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779343.514717:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663881856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779343.514812:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.516263:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663881856 00000100:00100000:2.0:1790779343.516283:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663881856 00000100:00100000:2.0:1790779343.516344:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790779343.516352:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1877767663881856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779343.516387:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790779343.516656:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1877767663881856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 304us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779343.516665:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790779343.516769:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663881856:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1790779343.518510:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790779343.519170:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1790779343.519349:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1790779343.519775:0:23452:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790779343.519779:0:23452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790779343.520561:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790779343.520574:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790779343.520614:0:23447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790779343.520635:0:23447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936e67c 00000100:00080000:0.0:1790779343.520645:0:23447:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790779343.520656:0:23447:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b7603908000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779343.520690:0:23447:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7711bf8000 x1877767663881984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790779343.520729:0:23447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790779343.520791:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779343.520796:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779343.520798:0:23447:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790779343.520802:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790779343.520804:0:23447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1790779343.520806:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790779343.520808:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790779343.520809:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790779343.520812:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779343.520813:0:23447:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790779343.520816:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790779343.520820:0:23447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790779343.520824:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779343.520825:0:23447:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790779343.520828:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790779343.520832:0:23447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.103@tcp to nid 0x20000c0a8cb67 (192.168.203.103@tcp) 00000020:01000000:0.0:1790779343.520852:0:23447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790779343.520856:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790779343.520867:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9b7727433380) 00000020:00000080:0.0:1790779343.520959:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1790779343.520967:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790779343.521038:0:23447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1790779343.521045:0:23447:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790779343.521049:0:23447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb1aa4014e936e68a 00010000:00080000:0.0:1790779343.521075:0:23447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b772012b000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:0.0:1790779343.521284:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1790779343.521349:0:23447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790779343.521364:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1790779343.521554:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663881984:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790779343.521608:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663881984 offset 0 length 520: 4 00000100:00080000:2.0:1790779343.521718:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779343.521723:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779343.521726:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779343.521728:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1790779343.525465:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790779343.526580:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1790779343.526731:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1790779343.527174:0:23454:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790779343.527179:0:23454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790779343.527968:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790779343.527980:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790779343.528016:0:23447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790779343.528038:0:23447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936e691 00000100:00080000:0.0:1790779343.528049:0:23447:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790779343.528059:0:23447:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b772012b000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779343.528093:0:23447:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7711bfb480 x1877767663882112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790779343.528114:0:23447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790779343.528162:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779343.528166:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779343.528168:0:23447:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790779343.528172:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779343.528176:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779343.528177:0:23447:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790779343.528180:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790779343.528182:0:23447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790779343.528184:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779343.528187:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779343.528188:0:23447:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790779343.528191:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779343.528193:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779343.528194:0:23447:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790779343.528198:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790779343.528352:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663882112:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790779343.528404:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663882112 offset 0 length 520: 4 00000100:00080000:2.0:1790779343.528505:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779343.528510:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779343.528513:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779343.528516:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1790779343.528555:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779343.528559:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779343.528560:0:23447:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790779343.528564:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1790779343.528699:0:23443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1790779343.528726:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1790779343.528749:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671600/0xb1aa4014e936e613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e61a expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.528761:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7602671600/0xb1aa4014e936e613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e61a expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779343.528770:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b770ea1b000 from 1 10000000:01000000:2.0:1790779343.528773:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790779343.528803:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.528811:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.528820:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779343.528834:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779343.528870:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.528916:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c900 going to sleep for 11 seconds 00000100:00100000:0.0:1790779343.529097:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663882240 00000100:00100000:0.0:1790779343.529110:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663882240 00000100:00100000:0.0:1790779343.529191:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790779343.529200:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+15:23443:x1877767663882240:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779343.529221:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779343.529234:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76034aec00/0xb1aa4014e936e69f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e698 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.529268:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76034aec00/0xb1aa4014e936e69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e698 expref: 16 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.529279:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76034aec00/0xb1aa4014e936e69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e698 expref: 16 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.529287:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034aec00, rc 0) 00000100:00100000:0.0:1790779343.529334:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+16:23443:x1877767663882240:12345-0@lo:101:mount.lustre.0 Request processed in 136us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779343.529342:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790779343.529405:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779343.529418:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.529426:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779343.529985:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882368:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790779343.530021:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.544511:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c900 going to sleep for 11 seconds 00000100:00100000:1.0:1790779343.553527:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663882368 00000100:00100000:1.0:1790779343.553547:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663882368 00000100:00100000:1.0:1790779343.553618:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790779343.553629:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+16:23443:x1877767663882368:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790779343.553683:0:22705:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790779343.553701:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790779343.553705:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1790779343.553846:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+16:23443:x1877767663882368:12345-0@lo:256:mount.lustre.0 Request processed in 219us (23823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779343.553855:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790779343.554069:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882368:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790779343.554703:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790779343.554718:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.554729:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779343.554745:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b770ea1b000 from 1 10000000:01000000:2.0:1790779343.554748:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790779343.554780:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.554788:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.554798:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779343.554817:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779343.554858:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.554930:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c900 going to sleep for 11 seconds 00000100:00100000:2.0:1790779343.554951:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663882496 00000100:00100000:2.0:1790779343.554956:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663882496 00000100:00100000:2.0:1790779343.554982:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790779343.554988:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+16:23443:x1877767663882496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779343.555000:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779343.555010:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e6ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e6a6 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.555031:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e6ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e6a6 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.555041:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e6ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e6a6 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.555060:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602670c00, rc 0) 00000100:00100000:2.0:1790779343.555092:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+17:23443:x1877767663882496:12345-0@lo:101:mount.lustre.0 Request processed in 103us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779343.555098:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790779343.555132:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779343.555144:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.555152:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779343.557485:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1790779343.557760:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790779343.558106:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1790779343.558134:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1790779343.558149:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1790779343.558163:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1790779343.558177:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1790779343.558207:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1790779343.558334:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1790779343.558350:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1790779343.558364:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1790779343.558377:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1790779343.558390:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1790779343.558409:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1790779343.558415:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1790779343.558579:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779343.558638:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.558734:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c480 going to sleep for 11 seconds 00000100:00100000:0.0:1790779343.561766:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663882624 00000100:00100000:0.0:1790779343.561784:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663882624 00000100:00100000:1.0:1790779343.567008:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790779343.567033:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+17:23443:x1877767663882624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779343.567329:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779343.567379:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882752:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779343.567436:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.567635:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c480 going to sleep for 11 seconds 00000100:00100000:1.0:1790779343.567672:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+17:23443:x1877767663882624:12345-0@lo:501:mount.lustre.0 Request processed in 191us (8573us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779343.567683:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790779343.567716:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663882752 00000100:00100000:1.0:1790779343.567723:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663882752 00000100:00100000:1.0:1790779343.567757:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790779343.567764:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+17:23443:x1877767663882752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779343.567851:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+17:23443:x1877767663882752:12345-0@lo:503:mount.lustre.0 Request processed in 87us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779343.567857:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790779343.568020:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882752:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790779343.568381:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790779343.568436:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779343.568622:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.568644:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c900 going to sleep for 11 seconds 00000100:00100000:3.0:1790779343.568764:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663882880 00000100:00100000:3.0:1790779343.568769:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663882880 00000100:00100000:3.0:1790779343.568793:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790779343.568799:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+17:23443:x1877767663882880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779343.568959:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+17:23443:x1877767663882880:12345-0@lo:502:mount.lustre.0 Request processed in 159us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779343.568966:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790779343.569377:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663882880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790779343.569648:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1790779343.569671:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1790779343.569683:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1790779343.569694:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1790779343.569705:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1790779343.569715:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1790779343.569726:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1790779343.569748:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1790779343.569763:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1790779343.569775:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1790779343.569787:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1790779343.569808:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779343.569843:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.569865:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760376c900 going to sleep for 11 seconds 00000100:00100000:1.0:1790779343.569967:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663883008 00000100:00100000:1.0:1790779343.569972:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663883008 00000100:00100000:1.0:1790779343.569996:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790779343.570002:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+17:23443:x1877767663883008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779343.573826:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+17:23443:x1877767663883008:12345-0@lo:502:mount.lustre.0 Request processed in 3812us (3971us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779343.573842:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790779343.573978:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790779343.574804:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1790779343.574832:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790779343.575634:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779343.575643:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779343.575646:0:23456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790779343.575652:0:23456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b770ea1b000 00000020:00000080:2.0:1790779343.575655:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790779343.575662:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779343.575664:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779343.575666:0:23456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790779343.575668:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779343.575670:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779343.575671:0:23456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790779343.575674:0:23456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b770ea1b000 00000020:00000080:2.0:1790779343.575676:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790779343.575738:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779343.575741:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779343.575743:0:23456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790779343.575746:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779343.575748:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779343.575749:0:23456:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790779343.575753:0:23456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b770ea1b000 00000020:00000080:2.0:1790779343.575755:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790779343.575775:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779343.575778:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779343.575779:0:23456:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790779343.575781:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779343.575784:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779343.575785:0:23456:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790779343.575789:0:23456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b770ea1b000 00000020:00000080:2.0:1790779343.575791:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790779343.575812:0:23456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779343.575815:0:23456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779343.575817:0:23456:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790779343.575819:0:23456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1790779343.577322:0:23443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790779343.577356:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779343.577377:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779343.577390:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779343.577462:0:23443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790779343.577465:0:23443:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b770ea1b000 10000000:01000000:1.0:1790779343.577469:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b770ea1b000 10000000:01000000:1.0:1790779343.577473:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790779343.577478:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b770ea1b000 from 1 10000000:01000000:1.0:1790779343.577481:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790779343.577515:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936e6b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779343.577535:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936e6b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779343.577547:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936e6b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779343.577572:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779343.577640:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779343.578329:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711bee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779343.580426:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663883136 00000100:00100000:3.0:1790779343.580436:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663883136 00000100:00100000:3.0:1790779343.580500:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790779343.580514:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+17:23443:x1877767663883136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779343.580530:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779343.580543:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e6bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e6b4 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779343.580568:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e6b4 expref: 18 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779343.580579:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894b000/0xb1aa4014e936e6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e6b4 expref: 18 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779343.580587:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b000, rc 0) 00000100:00100000:3.0:1790779343.580661:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663883136:12345-0@lo:101:mount.lustre.0 Request processed in 148us (3021us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779343.580668:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790779343.580724:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779343.580742:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936e6b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6bb expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779343.580750:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936e6b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e6bb expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790779343.601016:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1790779343.601337:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779343.601542:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1790779343.601565:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1790779343.601576:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1790779343.601589:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1790779343.601600:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1790779343.601624:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1790779343.601637:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1790779343.601651:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1790779343.601677:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1790779343.601693:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1790779343.601707:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1790779343.601719:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1790779343.601734:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1790779343.601747:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1790779343.601760:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1790779343.601774:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1790779343.601788:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1790779343.601802:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1790779343.601816:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1790779343.601829:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1790779343.601844:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1790779343.601858:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1790779343.601872:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1790779343.601928:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1790779343.601956:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1790779343.601974:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1790779343.601987:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1790779343.601999:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1790779343.602011:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1790779343.602022:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1790779343.602033:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1790779343.602044:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1790779343.602055:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1790779343.602066:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1790779343.602078:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1790779343.602089:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1790779343.602101:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1790779343.602115:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1790779343.602141:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1790779343.602156:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1790779343.602183:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1790779343.602199:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1790779343.602213:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1790779343.602226:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1790779343.602238:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1790779343.602270:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1790779343.602285:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1790779343.602298:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1790779343.602414:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1790779343.602435:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1790779343.602453:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1790779343.602459:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1790779343.602546:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779343.602607:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779343.602655:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc000 going to sleep for 11 seconds 00000100:00100000:1.0:1790779343.602967:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663883264 00000100:00100000:1.0:1790779343.602975:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663883264 00000100:00100000:1.0:1790779343.603021:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790779343.603030:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663883264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779343.603149:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663883264:12345-0@lo:501:mount.lustre.0 Request processed in 120us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779343.603157:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790779343.603204:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779343.603628:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779343.603668:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779343.603695:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711bee000 going to sleep for 11 seconds 00000100:00100000:3.0:1790779343.603783:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663883392 00000100:00100000:3.0:1790779343.603788:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663883392 00000100:00100000:3.0:1790779343.603814:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790779343.603820:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663883392:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779343.603920:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663883392:12345-0@lo:503:mount.lustre.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779343.603927:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790779343.606119:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883392:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790779343.609667:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790779343.609785:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779343.609856:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779343.609919:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711bee000 going to sleep for 11 seconds 00000100:00100000:3.0:1790779343.611486:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663883520 00000100:00100000:3.0:1790779343.611497:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663883520 00000100:00100000:3.0:1790779343.611554:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790779343.611564:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663883520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779343.611715:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663883520:12345-0@lo:502:mount.lustre.0 Request processed in 152us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779343.611729:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790779343.611794:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779343.612022:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1790779343.612051:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1790779343.612065:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1790779343.612079:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1790779343.612093:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1790779343.612107:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1790779343.612119:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1790779343.612134:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1790779343.612148:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1790779343.612162:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1790779343.612176:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1790779343.612204:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1790779343.612235:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1790779343.612262:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1790779343.612278:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1790779343.612292:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1790779343.612304:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1790779343.612317:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1790779343.612330:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1790779343.612343:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1790779343.612355:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1790779343.612366:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1790779343.612377:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1790779343.612390:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1790779343.612404:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1790779343.612417:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1790779343.612431:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1790779343.612461:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1790779343.612487:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1790779343.612501:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1790779343.612515:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1790779343.612529:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1790779343.612543:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1790779343.612556:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1790779343.612570:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1790779343.612583:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1790779343.612598:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1790779343.612612:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1790779343.612626:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1790779343.612640:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1790779343.612653:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1790779343.612665:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1790779343.612678:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1790779343.612706:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1790779343.612723:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1790779343.612735:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1790779343.612748:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1790779343.612763:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1790779343.612805:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779343.612855:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779343.612918:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663883648 00000100:00100000:3.0:1790779343.612923:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663883648 00000100:00100000:3.0:1790779343.612953:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790779343.612961:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663883648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779343.613041:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663883648:12345-0@lo:502:mount.lustre.0 Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779343.613047:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790779343.613091:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779343.613110:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779343.613236:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1790779343.613273:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1790779343.613295:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779343.613328:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779343.613352:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663883776 00000100:00100000:3.0:1790779343.613355:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663883776 00000100:00100000:3.0:1790779343.613378:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790779343.613384:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663883776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779343.613445:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663883776:12345-0@lo:502:mount.lustre.0 Request processed in 61us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779343.613451:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790779343.613481:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779343.613493:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663883776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779343.613525:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1790779343.613532:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1790779343.630477:0:23460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1790779343.630513:0:23460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9b7726b68000) 00000020:00000080:2.0:1790779343.630537:0:23460:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1790779343.630627:0:23460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b770ea1b000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1790779343.630632:0:23460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b770ea1b000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1790779343.630634:0:23460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b770ea1b000 3 00010000:00080000:2.0:1790779343.630664:0:23460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b773f473000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1790779343.638841:0:23460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1790779343.639059:0:23460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1790779343.639104:0:23460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790779343.639116:0:23460:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb1aa4014e936e6c9 00000100:00080000:2.0:1790779343.639126:0:23460:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790779343.639138:0:23460:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b773f473000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779343.639173:0:23460:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7735c17100 x1877767663883904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779343.641039:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877767663883904:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790779343.641109:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790779343.641177:0:23460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790779343.641203:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779343.641208:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790779343.641372:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663883904 00000100:00100000:3.0:1790779343.641379:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663883904 00000100:00100000:3.0:1790779343.641411:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790779343.641418:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663883904:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790779343.641441:0:22713:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:3.0:1790779343.641476:0:22713:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb1aa4014e936e6d0 00000004:00100000:3.0:1790779343.641489:0:22713:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790779343.641517:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9b7603bdc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779343.641581:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1877767663883904:12345-0@lo:38:llog_process_th.0 Request processed in 163us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779343.641598:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790779343.642233:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779343.642238:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1790779343.642297:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b7735c17100 x1877767663883904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779343.642309:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790779343.642317:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1790779343.642333:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790779343.642337:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790779343.642340:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b773f473000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790779343.642346:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1877767663883904:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1790779343.643106:0:23460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1790779343.646087:0:23443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790779343.646125:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790779343.646153:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936e6b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6bb expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.646167:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be7400/0xb1aa4014e936e6b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6bb expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790779343.646239:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790779343.646252:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790779343.646253:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779343.646254:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779343.646255:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779343.646257:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779343.646258:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790779343.646260:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779343.646261:0:23443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790779343.646265:0:23443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1790779343.646268:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790779343.646269:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790779343.646270:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779343.646272:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779343.646273:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779343.646274:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779343.646275:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790779343.646276:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779343.646277:0:23443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790779343.646305:0:23443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790779343.646323:0:23443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663884032:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790779343.646405:0:23443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.646443:0:23443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771d81b480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779343.646466:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663884032 00000100:00100000:2.0:1790779343.646473:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663884032 00000100:00100000:2.0:1790779343.646516:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790779343.646525:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663884032:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790779343.646553:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790779343.646566:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1790779343.653763:0:22691:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1790779343.653832:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790779343.653898:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1790779343.654183:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:23443:x1877767663884032:12345-0@lo:253:mount.lustre.0 Request processed in 7655us (7774us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779343.654196:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790779343.654320:0:23443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:23443:1877767663884032:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790779343.654334:0:23443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1790779343.654337:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790779343.654339:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790779343.654340:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779343.654341:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779343.654342:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779343.654344:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779343.654345:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790779343.654347:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779343.654348:0:23443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790779343.654362:0:23443:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1790779343.655302:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790779343.655307:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790779343.655326:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.655342:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e5d4 expref: 17 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.655350:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b76034aec00/0xb1aa4014e936e69f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e698 expref: 17 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.655370:0:22727:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.655405:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b76034aec00/0xb1aa4014e936e69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e698 expref: 17 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.655418:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b76034aec00/0xb1aa4014e936e69f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e698 expref: 17 pid: 22703 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779343.655430:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663884160:0@lo:104: 00000100:00100000:0.0:1790779343.655527:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790779343.655614:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e5db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e5d4 expref: 17 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779343.655622:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e5db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e5d4 expref: 17 pid: 22703 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779343.655630:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663884288:0@lo:104: 00000100:00100000:0.0:1790779343.655652:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779343.666968:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00000100:00100000:2.0:1790779343.667025:0:22695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663884160 00000100:00100000:2.0:1790779343.667034:0:22695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663884160 00000100:00100000:2.0:1790779343.667072:0:22695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663884288 00000100:00100000:2.0:1790779343.667074:0:22695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663884288 00000100:00100000:2.0:1790779343.667089:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779343.667096:0:22695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+4:22727:x1877767663884160:12345-0@lo:104: 00010000:00010000:2.0:1790779343.667113:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667187:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790779343.667193:0:22695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+4:22727:x1877767663884160:12345-0@lo:104: Request processed in 98us (11666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779343.667200:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779343.667223:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779343.667229:0:22695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+3:22727:x1877767663884288:12345-0@lo:104: 00010000:00010000:2.0:1790779343.667236:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667295:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790779343.667300:0:22695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+3:22727:x1877767663884288:12345-0@lo:104: Request processed in 72us (11647us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779343.667306:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790779343.667321:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779343.667326:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667334:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779343.667338:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667347:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779343.667354:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779343.667360:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790779343.667390:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667396:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779343.667415:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667422:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7602671000/0xb1aa4014e936e698 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e69f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667454:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779343.667457:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667462:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779343.667465:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667471:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779343.667477:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779343.667482:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790779343.667495:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667501:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779343.667515:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667521:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e5d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e5db expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667533:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779343.667534:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779343.667536:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779343.667554:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663884416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779343.667596:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.667634:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663884544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779343.667653:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779343.667676:0:22696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663884416 00000100:00100000:2.0:1790779343.667679:0:22696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663884416 00010000:00010000:2.0:1790779343.667696:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b76034aec00/0xb1aa4014e936e69f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e698 expref: 18 pid: 22703 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779343.667710:0:22696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663884544 00000100:00100000:2.0:1790779343.667712:0:22696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663884544 00010000:00010000:2.0:1790779343.667719:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e5db lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e5d4 expref: 19 pid: 22703 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779343.667729:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779343.667733:0:22696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+19:3650:x1877767663884416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779343.667742:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779343.667746:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b76034aec00/0xb1aa4014e936e69f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e698 expref: 19 pid: 22703 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667755:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b76034aec00/0xb1aa4014e936e69f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e698 expref: 19 pid: 22703 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667770:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779343.667794:0:22696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+19:3650:x1877767663884416:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779343.667799:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779343.667809:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779343.667815:0:22696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+18:3651:x1877767663884544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779343.667821:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779343.667831:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e5db lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e5d4 expref: 18 pid: 22703 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667839:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e5db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e5d4 expref: 18 pid: 22703 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667849:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667856:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790779343.667869:0:22696:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012562762s 00010000:00010000:2.0:1790779343.667874:0:22696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667911:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667918:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667924:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667928:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779343.667932:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667938:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667946:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779343.667961:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779343.667986:0:22696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+18:3651:x1877767663884544:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779343.667991:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779343.668022:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663884416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779343.668053:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663884544:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1790779343.668095:0:23443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1790779343.668198:0:23467:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1790779343.668202:0:23467:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00010000:00010000:0.0:1790779343.668427:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790779343.668573:0:23469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790779343.669012:0:23443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1790779343.674470:0:23469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790779343.680665:0:23469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790779343.680746:0:23469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1790779343.681018:0:23443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1790779343.681056:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790779343.681865:0:22727:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702bc0780 going to sleep for 11 seconds 00010000:00010000:1.0:1790779343.681920:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76034aec00/0xb1aa4014e936e69f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e698 expref: 17 pid: 22703 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779343.681935:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663884160:0@lo:104: 00010000:00010000:1.0:1790779343.681950:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76034afa00/0xb1aa4014e936e5db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e5d4 expref: 16 pid: 22703 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779343.681958:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663884288:0@lo:104: 00010000:00010000:1.0:1790779343.681979:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779343.681988:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779343.681995:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779343.682000:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e6d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779343.689055:0:23470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1877767663884672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790779343.689125:0:23470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779343.689173:0:23470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772010c240 going to sleep for 11 seconds 00000004:00000080:2.0:1790779343.689823:0:23443:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790779343.689838:0:23443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1790779343.689946:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790779343.691112:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663884672 00000100:00100000:1.0:1790779343.691123:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663884672 00000100:00100000:1.0:1790779343.691182:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790779343.691192:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23470:x1877767663884672:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790779343.691424:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23470:x1877767663884672:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 233us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779343.691433:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779343.691578:0:23470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1877767663884672:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1790779343.691616:0:23470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1790779343.691652:0:23470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1877767663884800:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790779343.691691:0:23470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779343.691727:0:23470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702abbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779343.691774:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663884800 00000100:00100000:0.0:1790779343.691778:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663884800 00000100:00100000:0.0:1790779343.691808:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779343.691816:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23470:x1877767663884800:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790779343.691952:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23470:x1877767663884800:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 137us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779343.691973:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790779343.692084:0:23470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1877767663884800:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790779343.692139:0:23470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23470:1877767663884928:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790779343.692168:0:23470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779343.692198:0:23470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702abb840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779343.692312:0:22722:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663884928 00000100:00100000:0.0:1790779343.692316:0:22722:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663884928 00000100:00100000:0.0:1790779343.692388:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790779343.692396:0:22722:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23470:x1877767663884928:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1790779343.692435:0:22722:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23470:x1877767663884928:12345-0@lo:900:lod0001_rec0000.0 Request processed in 40us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779343.692456:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790779343.692623:0:23470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b7603831f80 x1877767663884928/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790779359 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779343.692643:0:23470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23470:1877767663884928:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1790779343.692681:0:23470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1877767663885056:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1790779343.692707:0:23470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779343.692732:0:23470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7702abbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779343.692789:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663885056 00000100:00100000:1.0:1790779343.692800:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663885056 00000100:00100000:1.0:1790779343.692821:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790779343.692827:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23470:x1877767663885056:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790779343.692906:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23470:x1877767663885056:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779343.692913:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:2.0:1790779343.693114:0:23443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1790779343.693405:0:23470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1877767663885056:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1790779343.693461:0:23470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790779343.695026:0:23443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790779343.695085:0:23443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1790779343.697058:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779343.698750:0:23470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790779343.698821:0:23470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790779343.698825:0:23470:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:0.0:1790779343.701159:0:23443:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1790779343.708585:0:23443:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1790779343.710102:0:23443:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790779343.710139:0:23443:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbc92c1cbf988 00100000:10000000:1.0:1790779343.710146:0:23443:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1790779343.710929:0:23443:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790779343.710962:0:23443:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790779343.710984:0:23443:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790779343.711005:0:23443:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1790779343.711742:0:23443:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779343.711973:0:23443:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790779344.232054:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790779344.680641:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790779344.681521:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00010000:00010000:0.0:1790779345.263123:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790779345.449063:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790779345.449070:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b770ea1b000 from 12 10000000:01000000:2.0:1790779345.449075:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790779345.449118:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779345.449131:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779345.449143:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779345.449167:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663885184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790779345.449243:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779345.449296:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77036f0300 going to sleep for 11 seconds 00000100:00100000:1.0:1790779345.449381:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663885184 00000100:00100000:1.0:1790779345.449396:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663885184 00000100:00100000:1.0:1790779345.449443:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790779345.449452:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+16:22707:x1877767663885184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779345.449464:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779345.449476:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7603be6a00/0xb1aa4014e936e6e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e6de expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779345.449497:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be6a00/0xb1aa4014e936e6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e6de expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779345.449507:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7603be6a00/0xb1aa4014e936e6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e6de expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779345.449516:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6a00, rc 0) 00000100:00100000:1.0:1790779345.449560:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+17:22707:x1877767663885184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779345.449566:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790779345.449619:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663885184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779345.449632:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779345.449640:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779345.449693:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663885312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790779345.449721:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779345.449735:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760345b540 going to sleep for 11 seconds 00000100:00100000:2.0:1790779345.449836:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663885312 00000100:00100000:2.0:1790779345.449841:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663885312 00000100:00100000:2.0:1790779345.449895:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790779345.449902:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+17:22707:x1877767663885312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790779345.449916:0:22703:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790779345.449932:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790779345.449935:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1790779345.450068:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+17:22707:x1877767663885312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 166us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779345.450074:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790779345.450203:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663885312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790779345.450299:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790779345.450307:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779345.450317:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779345.450325:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790779345.450327:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b773c016000 from 12 10000000:01000000:1.0:1790779345.450330:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790779345.450345:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779345.450353:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779345.450361:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779345.450381:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663885440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779345.450474:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779345.450531:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760345b540 going to sleep for 11 seconds 00000100:00100000:2.0:1790779345.454502:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663885440 00000100:00100000:2.0:1790779345.454518:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663885440 00000100:00100000:3.0:1790779345.460627:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790779345.460642:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+17:22707:x1877767663885440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779345.460661:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779345.460679:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e6f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e6ec expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779345.460706:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e6f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e6ec expref: 18 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779345.460718:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e6f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e6ec expref: 18 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779345.460726:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b400, rc 0) 00000100:00100000:3.0:1790779345.460817:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+18:22707:x1877767663885440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (10341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779345.460833:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790779345.461504:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663885440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779345.461525:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779345.461535:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779345.461599:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663885568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790779345.461643:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779345.461678:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76024f26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779345.461693:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663885568 00000100:00100000:3.0:1790779345.461699:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663885568 00000100:00100000:3.0:1790779345.461728:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790779345.461736:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+18:22707:x1877767663885568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790779345.461751:0:22704:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790779345.461768:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790779345.461771:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1790779345.461851:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+18:22707:x1877767663885568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779345.461871:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790779345.464129:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663885568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790779345.464191:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790779345.464202:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779345.464225:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779345.704027:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00000040:00080000:1.0:1790779345.712284:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790779346.282980:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779346.731363:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00010000:00010000:3.0:1790779347.311849:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779347.752565:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00000001:02000400:3.0:1790779348.256654:0:23712:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790779348.328048:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779348.589107:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790779348.589127:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663885696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779348.589849:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779348.589927:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663885696 00000100:00100000:3.0:1790779348.589934:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663885696 00000100:00100000:3.0:1790779348.589976:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779348.589984:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663885696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790779348.590016:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790779348.590063:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663885696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779348.590070:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779348.590112:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663885696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779348.776949:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 0 seconds 00000100:00080000:0.0:1790779349.096766:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790779349.096772:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790779349.096776:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b77041d3800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779349.096790:0:9333:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b77041d3800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779349.096812:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7711bf9f80 x1877767663885952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790779349.096830:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779349.096834:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790779349.096837:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779349.096840:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790779349.096864:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779349.096867:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790779349.096869:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779349.096907:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790779349.096941:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663885952:0@lo:38:kworker.0 00000100:00100000:0.0:1790779349.097001:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779349.097071:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663886208:0@lo:400:kworker.0 00000100:00100000:0.0:1790779349.097097:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779349.097117:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790779349.097123:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663886336:0@lo:400:kworker.0 00000100:00100000:0.0:1790779349.097148:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779349.097185:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663885952 00000100:00100000:0.0:1790779349.097193:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663885952 00000100:00100000:0.0:1790779349.097229:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663886208 00000100:00100000:0.0:1790779349.097232:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663886208 00000100:00100000:0.0:1790779349.097253:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790779349.097261:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1877767663885952:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790779349.097286:0:22716:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:0.0:1790779349.097316:0:22716:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936e6fa 00000004:00100000:0.0:1790779349.097329:0:22716:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1790779349.097335:0:22716:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1790779349.097456:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663885824:0@lo:400:kworker.0 00000100:00100000:1.0:1790779349.097491:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779349.097523:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779349.097529:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663886080:0@lo:400:kworker.0 00000100:00100000:1.0:1790779349.097551:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779349.097580:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663886336 00000100:00100000:1.0:1790779349.097584:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663886336 00000100:00100000:1.0:1790779349.097610:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663886080 00000100:00100000:1.0:1790779349.097613:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663886080 00000100:00100000:1.0:1790779349.097637:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790779349.097644:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663886336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779349.097691:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663886336:12345-0@lo:400:kworker.0 Request processed in 47us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779349.097698:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790779349.097715:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790779349.097721:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663886080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779349.097751:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663886080:12345-0@lo:400:kworker.0 Request processed in 31us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779349.097756:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790779349.097803:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7711bf9c00 x1877767663886336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779349.097816:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663886336:0@lo:400:kworker.0 00010000:00080000:1.0:1790779349.097841:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7711bfb800 x1877767663886080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779349.097850:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663886080:0@lo:400:kworker.0 00000100:00100000:0.0:1790779349.098550:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663885824 00000100:00100000:0.0:1790779349.098556:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663885824 00000100:00100000:0.0:1790779349.098595:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790779349.098602:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+18:3649:x1877767663885824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779349.098662:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+18:3649:x1877767663885824:12345-0@lo:400:kworker.0 Request processed in 60us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779349.098668:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790779349.098733:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663885824:0@lo:400:kworker.0 00000100:00080000:1.0:1790779349.107503:0:22716:0:(import.c:65:import_set_state_nolock()) ffff9b770eb7b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790779349.107722:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1877767663885952:12345-0@lo:38:kworker.0 Request processed in 10458us (10718us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779349.107734:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790779349.107765:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790779349.107777:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663886208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779349.107833:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663886208:12345-0@lo:400:kworker.0 Request processed in 61us (10734us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779349.107840:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779349.108822:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663886208:0@lo:400:kworker.0 00000100:00080000:0.0:1790779349.112784:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1790779349.112816:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790779349.112822:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790779349.112826:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b77041d3800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1790779349.112854:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000178eb53d): req@ffff9b7603744a80 x1877767663878912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779349.112876:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663885952:0@lo:38:kworker.0 00000100:00100000:3.0:1790779349.113075:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779349.113114:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b772011bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779349.113226:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790779349.113245:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663886464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779349.113278:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779349.113307:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663878912 00000100:00100000:2.0:1790779349.113313:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663878912 00000100:00100000:2.0:1790779349.113356:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663886464 00000100:00100000:2.0:1790779349.113359:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663886464 00000100:00100000:2.0:1790779349.113372:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790779349.113380:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22752:x1877767663878912:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790779349.113459:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22752:x1877767663878912:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779349.113466:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790779349.113483:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790779349.113489:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1877767663886464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790779349.113510:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790779349.113545:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1877767663886464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779349.113551:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790779349.113580:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663886464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779349.113607:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22752:1877767663878912:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1790779349.113845:0:22752:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1790779349.113907:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22752:1877767663886592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790779349.113942:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779349.113968:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760345bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1790779349.114040:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663886592 00000100:00100000:3.0:1790779349.114045:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663886592 00000100:00100000:3.0:1790779349.114065:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790779349.114070:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22752:x1877767663886592:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790779349.114186:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22752:x1877767663886592:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 114us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779349.114192:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790779349.114720:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22752:1877767663886592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790779349.114783:0:22752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22752:1877767663886720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790779349.114817:0:22752:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779349.114840:0:22752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b760345bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779349.116578:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663886720 00000100:00100000:2.0:1790779349.116591:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663886720 00000100:00100000:2.0:1790779349.116655:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790779349.116665:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22752:x1877767663886720:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790779349.116782:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22752:x1877767663886720:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 119us (1964us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779349.116790:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790779349.116932:0:22752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22752:1877767663886720:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1790779349.116994:0:22752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790779349.119135:0:22752:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790779349.119233:0:22752:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:0.0:1790779349.119238:0:22752:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1790779349.263509:0:23765:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779349.263701:0:23765:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779349.352969:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779350.378679:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1790779350.445783:0:23815:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779350.447297:0:23815:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779351.400277:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790779351.729297:0:23863:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceea85600 20000000:00000080:3.0:1790779351.729314:0:23863:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b7710d63c00 uarg=0000000000000000 20000000:01000000:3.0:1790779351.729353:0:23863:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790779351.729359:0:23863:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790779351.729363:0:23863:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790779351.730564:0:23864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1790779351.730848:0:23863:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790779351.741381:0:23863:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790779351.741409:0:23863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779351.741428:0:23863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e5a3 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779351.741436:0:23863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e6ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e6a6 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779351.741444:0:23863:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779351.741485:0:23863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e6ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e6a6 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779351.741499:0:23863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e6ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e6a6 expref: 17 pid: 22705 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779351.741512:0:23863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23863:1877767663886848:0@lo:104: 00000100:00100000:3.0:1790779351.741572:0:23863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790779351.741647:0:23863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e5a3 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779351.741655:0:23863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e5aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e5a3 expref: 17 pid: 22705 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779351.741686:0:23863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23863:1877767663886976:0@lo:104: 00000100:00100000:3.0:1790779351.741709:0:23863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779351.741736:0:23863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77344b43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779351.741782:0:22695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663886848 00000100:00100000:2.0:1790779351.741790:0:22695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663886848 00000100:00100000:2.0:1790779351.741828:0:22695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663886976 00000100:00100000:2.0:1790779351.741831:0:22695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663886976 00000100:00100000:2.0:1790779351.741846:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779351.741855:0:22695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+4:23863:x1877767663886848:12345-0@lo:104: 00010000:00010000:2.0:1790779351.741873:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.741945:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790779351.741951:0:22695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+4:23863:x1877767663886848:12345-0@lo:104: Request processed in 98us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779351.741959:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779351.741976:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779351.741984:0:22695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+3:23863:x1877767663886976:12345-0@lo:104: 00010000:00010000:2.0:1790779351.741992:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742029:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790779351.742034:0:22695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+3:23863:x1877767663886976:12345-0@lo:104: Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779351.742041:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790779351.742058:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779351.742064:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742073:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779351.742077:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742087:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779351.742094:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779351.742100:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779351.742136:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742143:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779351.742161:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742168:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7602671400/0xb1aa4014e936e6a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e6ad expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742201:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779351.742204:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742210:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779351.742213:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742219:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779351.742226:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779351.742231:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779351.742244:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742250:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779351.742266:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742273:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7602671200/0xb1aa4014e936e5a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e5aa expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742284:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779351.742286:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779351.742288:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779351.742299:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663887104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779351.742331:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779351.742366:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663887232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779351.742387:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779351.742426:0:22697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663887104 00000100:00100000:2.0:1790779351.742430:0:22697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663887104 00010000:00010000:2.0:1790779351.742446:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e6ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e6a6 expref: 18 pid: 22705 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779351.742462:0:22697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663887232 00000100:00100000:2.0:1790779351.742465:0:22697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663887232 00010000:00010000:2.0:1790779351.742474:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e5aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e5a3 expref: 19 pid: 22705 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779351.742485:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779351.742491:0:22697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9d73c52-009d-4820-b396-7792bc096088+19:3650:x1877767663887104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779351.742500:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779351.742504:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e6ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e6a6 expref: 19 pid: 22705 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742514:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e6ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e6a6 expref: 19 pid: 22705 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742527:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779351.742550:0:22697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9d73c52-009d-4820-b396-7792bc096088+19:3650:x1877767663887104:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779351.742556:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779351.742568:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779351.742574:0:22697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9d73c52-009d-4820-b396-7792bc096088+18:3651:x1877767663887232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779351.742581:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779351.742590:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e5aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e5a3 expref: 18 pid: 22705 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742599:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e5aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e5a3 expref: 18 pid: 22705 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742610:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742618:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742629:0:22697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742641:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742648:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742655:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742661:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779351.742665:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742672:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742680:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779351.742694:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779351.742719:0:22697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9d73c52-009d-4820-b396-7792bc096088+18:3651:x1877767663887232:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779351.742725:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779351.742758:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663887232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779351.742776:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663887104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779351.744860:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779351.745136:0:23863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e6ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e6a6 expref: 17 pid: 22705 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779351.745237:0:23863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23863:1877767663886848:0@lo:104: 00010000:00010000:3.0:1790779351.745256:0:23863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e5aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e5a3 expref: 16 pid: 22705 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779351.745266:0:23863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23863:1877767663886976:0@lo:104: 00010000:00010000:3.0:1790779351.745288:0:23863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779351.745300:0:23863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779351.745307:0:23863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779351.745313:0:23863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894b200/0xb1aa4014e936e701 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779351.785801:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779352.424158:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779353.193365:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779343/real 1790779343] req@ffff9b7711bfb480 x1877767663882112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779353 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779353.193398:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7711bfb480 x1877767663882112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779353 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779353.193410:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779343/real 1790779343] req@ffff9b7711bf8000 x1877767663881984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779353 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779353.193423:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7711bf8000 x1877767663881984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779353 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790779353.193441:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b772012b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779353.193473:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790779353.193478:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663882112:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790779353.193484:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7603908000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779353.193490:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790779353.193493:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663881984:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790779353.193755:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779353.193761:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779353.193764:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779353.193773:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779353.193793:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779353.193796:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790779353.193798:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7603908000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779353.193803:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 661 00000100:00080000:1.0:1790779353.193808:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790779353.193818:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b7603908000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779353.193836:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603745180 x1877767663887872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790779353.193850:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779353.193853:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790779353.193855:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b772012b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779353.193858:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 661 00000100:00080000:1.0:1790779353.193871:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790779353.193876:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b772012b000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779353.193912:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603746d80 x1877767663888000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779353.193945:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663887488:0@lo:400:kworker.0 00000100:00100000:1.0:1790779353.194002:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779353.194044:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779353.194050:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663887616:0@lo:400:kworker.0 00000100:00100000:1.0:1790779353.194075:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779353.194106:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663887488 00000100:00100000:1.0:1790779353.194113:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663887488 00000100:00100000:1.0:1790779353.194165:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790779353.194189:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663887488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779353.194242:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663887488:12345-0@lo:400:kworker.0 Request processed in 55us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779353.194249:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790779353.194271:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663887616 00000100:00100000:1.0:1790779353.194275:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663887616 00000100:00100000:1.0:1790779353.194298:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790779353.194305:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663887616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779353.194334:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663887616:12345-0@lo:400:kworker.0 Request processed in 30us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779353.194340:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790779353.194373:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7603747100 x1877767663887616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779353.194385:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663887616:0@lo:400:kworker.0 00000100:00100000:1.0:1790779353.194395:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663887488:0@lo:400:kworker.0 00000100:00100000:1.0:1790779353.194414:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663887872:0@lo:8:kworker.0 00000400:00000100:1.0:1790779353.194438:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663887872 offset 0 length 520: 4 00000100:00100000:1.0:1790779353.194456:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663888000:0@lo:8:kworker.0 00000400:00000100:1.0:1790779353.194470:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663888000 offset 0 length 520: 4 00000100:00100000:3.0:1790779353.194650:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663887744:0@lo:400:kworker.0 00000100:00100000:3.0:1790779353.194683:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779353.194714:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790779353.194720:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663887360:0@lo:400:kworker.0 00000100:00100000:3.0:1790779353.194741:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779353.194763:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663888128:0@lo:400:kworker.0 00000100:00100000:3.0:1790779353.194780:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779353.194801:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663887360 00000100:00100000:3.0:1790779353.194805:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663887360 00000100:00100000:3.0:1790779353.194830:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790779353.194835:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+16:3651:x1877767663887360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779353.194866:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+16:3651:x1877767663887360:12345-0@lo:400:kworker.0 Request processed in 31us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779353.194872:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790779353.194912:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663888128 00000100:00100000:3.0:1790779353.194916:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663888128 00000100:00100000:3.0:1790779353.194933:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779353.194939:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663888128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779353.194965:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663888128:12345-0@lo:400:kworker.0 Request processed in 26us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779353.194970:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779353.194992:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663887360:0@lo:400:kworker.0 00010000:00080000:3.0:1790779353.195001:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7603745500 x1877767663888128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779353.195009:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663888128:0@lo:400:kworker.0 00000100:00100000:1.0:1790779353.195142:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663887744 00000100:00100000:1.0:1790779353.195157:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663887744 00000100:00100000:1.0:1790779353.195197:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790779353.195202:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663887744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779353.195234:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663887744:12345-0@lo:400:kworker.0 Request processed in 32us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779353.195246:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790779353.195352:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663887744:0@lo:400:kworker.0 10000000:01000000:3.0:1790779353.203337:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790779353.203344:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b770ea1b000 from 13 10000000:01000000:3.0:1790779353.203349:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790779353.203393:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779353.203405:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779353.203417:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779353.203451:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790779353.203519:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779353.203576:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77344b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779353.203640:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663888256 00000100:00100000:2.0:1790779353.203648:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663888256 00000100:00100000:2.0:1790779353.203696:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790779353.203704:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+16:22707:x1877767663888256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779353.203717:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779353.203729:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7602670800/0xb1aa4014e936e70f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e708 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779353.203751:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7602670800/0xb1aa4014e936e70f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e708 expref: 17 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779353.203760:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7602670800/0xb1aa4014e936e70f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e708 expref: 17 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779353.203770:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602670800, rc 0) 00000100:00100000:2.0:1790779353.203816:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+17:22707:x1877767663888256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779353.203823:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790779353.203918:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779353.203931:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779353.203940:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779353.203993:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779353.204017:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779353.204034:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779353.204197:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663888384 00000100:00100000:2.0:1790779353.204202:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663888384 00000100:00100000:2.0:1790779353.204225:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790779353.204231:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773435b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+17:22707:x1877767663888384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779353.204332:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773435b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+17:22707:x1877767663888384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779353.204340:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790779353.204485:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779353.204512:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779353.204551:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779353.204585:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779353.204670:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663888512 00000100:00100000:2.0:1790779353.204674:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663888512 00000100:00100000:2.0:1790779353.204699:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790779353.204711:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773435a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+17:22707:x1877767663888512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790779353.204773:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773435a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+17:22707:x1877767663888512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779353.204780:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790779353.205276:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790779353.210264:0:23929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790779353.214346:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790779353.214385:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779353.214397:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779353.214409:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779353.214420:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790779353.214434:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b773c016000 from 13 10000000:01000000:1.0:1790779353.214437:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779353.214470:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779353.214479:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779353.214489:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779353.214511:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779353.215013:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779353.215080:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779353.218279:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663888640 00000100:00100000:2.0:1790779353.218292:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663888640 00000100:00100000:3.0:1790779353.218412:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790779353.218422:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+17:22707:x1877767663888640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779353.218439:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779353.218455:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e71d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e716 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779353.218481:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e716 expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779353.218492:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e716 expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779353.218499:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894ac00, rc 0) 00000100:00100000:3.0:1790779353.218588:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+18:22707:x1877767663888640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779353.218605:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790779353.218766:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779353.218783:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779353.218791:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779353.218857:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779353.219135:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779353.219182:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b728600 going to sleep for 11 seconds 00000100:00100000:1.0:1790779353.219225:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663888768 00000100:00100000:1.0:1790779353.219230:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663888768 00000100:00100000:1.0:1790779353.219259:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790779353.219265:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+18:22707:x1877767663888768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779353.219378:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+18:22707:x1877767663888768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779353.219384:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790779353.219484:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779353.219511:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790779353.219546:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779353.219571:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773b728600 going to sleep for 11 seconds 00000100:00100000:1.0:1790779353.219648:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663888896 00000100:00100000:1.0:1790779353.219652:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663888896 00000100:00100000:1.0:1790779353.219676:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790779353.219682:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:22707:x1877767663888896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779353.219747:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:22707:x1877767663888896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779353.219753:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790779353.219785:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663888896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790779353.220510:0:23930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790779353.220671:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790779353.220690:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779353.220698:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779353.220708:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779353.457058:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779353.705714:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790779353.705746:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663889024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779353.705853:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779353.705947:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663889024 00000100:00100000:0.0:1790779353.705957:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663889024 00000100:00100000:0.0:1790779353.706145:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790779353.706156:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663889024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790779353.706219:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790779353.706279:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663889024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779353.706288:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790779353.706342:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663889024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779354.224005:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779339/real 1790779339] req@ffff9b7603831500 x1877767663879936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779354 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779354.224059:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603831500 x1877767663879936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779354 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779354.224072:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779339/real 1790779339] req@ffff9b7603833b80 x1877767663880064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779354 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779354.224084:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603833b80 x1877767663880064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779354 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790779354.224108:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7711c96000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790779354.224269:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790779354.224274:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663879936:0@lo:8:kworker.0 00000100:00080000:0.0:1790779354.224281:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7741db3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779354.224384:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779354.224389:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790779354.224393:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7711c96000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779354.224398:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 657 00000100:00080000:1.0:1790779354.224405:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790779354.224418:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b7711c96000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779354.224462:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603744000 x1877767663889408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790779354.224473:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779354.224476:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790779354.224478:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b7741db3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779354.224482:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 657 00000100:00080000:1.0:1790779354.224484:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790779354.224490:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b7741db3000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779354.224501:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603747480 x1877767663889536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790779354.224537:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779354.224540:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779354.224543:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779354.224545:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790779354.224582:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663889664:0@lo:400:kworker.0 00000100:00100000:1.0:1790779354.224685:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779354.224728:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790779354.224735:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663889280:0@lo:400:kworker.0 00000100:00100000:1.0:1790779354.224772:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779354.224809:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663889664 00000100:00100000:1.0:1790779354.224819:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663889664 00000100:00100000:1.0:1790779354.224873:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790779354.224909:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663889664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779354.224965:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663889664:12345-0@lo:400:kworker.0 Request processed in 58us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779354.224973:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790779354.225019:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7603747800 x1877767663889664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779354.225032:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663889664:0@lo:400:kworker.0 00000100:00080000:0.0:1790779354.225267:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790779354.225273:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663880064:0@lo:8:kworker.0 00000100:00100000:0.0:1790779354.225300:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663889152:0@lo:400:kworker.0 00000100:00100000:0.0:1790779354.225341:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779354.225380:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663889920:0@lo:400:kworker.0 00000100:00100000:0.0:1790779354.225404:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779354.225426:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790779354.225432:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663889792:0@lo:400:kworker.0 00000100:00100000:0.0:1790779354.225455:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779354.225485:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663889280 00000100:00100000:0.0:1790779354.225490:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663889280 00000100:00100000:0.0:1790779354.225515:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663889792 00000100:00100000:0.0:1790779354.225518:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663889792 00000100:00100000:0.0:1790779354.225544:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790779354.225551:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663889280:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790779354.225777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779354.225783:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779354.225786:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779354.225798:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790779354.225854:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663889280:12345-0@lo:400:kworker.0 Request processed in 302us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779354.225861:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790779354.225896:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790779354.225904:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663889792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779354.226000:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663889792:12345-0@lo:400:kworker.0 Request processed in 96us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779354.226006:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790779354.226025:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663889152 00000100:00100000:0.0:1790779354.226030:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663889152 00000100:00100000:0.0:1790779354.226063:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790779354.226071:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:3650:x1877767663889152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779354.226103:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+18:3650:x1877767663889152:12345-0@lo:400:kworker.0 Request processed in 33us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779354.226108:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790779354.226149:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663889920 00000100:00100000:0.0:1790779354.226153:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663889920 00000100:00100000:0.0:1790779354.226192:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779354.226200:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663889920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779354.226235:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663889920:12345-0@lo:400:kworker.0 Request processed in 36us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779354.226241:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779354.226282:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663889280:0@lo:400:kworker.0 00000100:00100000:0.0:1790779354.226316:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663889408:0@lo:8:kworker.0 00000400:00000100:0.0:1790779354.226350:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663889408 offset 0 length 520: 4 00000100:00100000:0.0:1790779354.226375:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663889536:0@lo:8:kworker.0 00000400:00000100:0.0:1790779354.226395:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877767663889536 offset 0 length 520: 4 00000100:00100000:0.0:1790779354.226611:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663890048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779354.226642:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779354.226789:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663890048 00000100:00100000:3.0:1790779354.226795:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663890048 00000100:00100000:3.0:1790779354.226830:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790779354.226838:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663890048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779354.226872:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790779354.226960:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1877767663890048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779354.226967:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790779354.227054:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663890048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779354.227130:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663889792:0@lo:400:kworker.0 00000100:00100000:1.0:1790779354.227218:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663889152:0@lo:400:kworker.0 00010000:00080000:1.0:1790779354.227238:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7603745500 x1877767663889920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779354.227249:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663889920:0@lo:400:kworker.0 00010000:00010000:2.0:1790779354.472721:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790779354.732370:0:23444:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1790779355.500599:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790779355.944858:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779356.524683:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779357.544077:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790779358.469383:0:24211:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790779358.469389:0:24211:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1790779358.469391:0:24211:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790779358.469522:0:24211:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b7603bd9000 00000020:01000004:3.0:1790779358.469544:0:24211:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790779358.469562:0:24211:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790779358.469581:0:24211:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b77041c99c0) 00000020:00000080:3.0:1790779358.469602:0:24211:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790779358.550846:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1790779358.553527:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790779358.553986:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790779358.554372:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790779358.554947:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1790779358.555219:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790779358.555466:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1790779358.556823:0:24211:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790779358.557063:0:24211:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1790779358.557076:0:24211:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790779358.557088:0:24211:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb1aa4014e936e72b 00000020:01000004:1.0:1790779358.557096:0:24211:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1790779358.557297:0:24211:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790779358.557301:0:24211:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790779358.557307:0:24211:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1790779358.557313:0:24211:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1790779358.557325:0:24211:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b7603223380) 00000020:00000080:1.0:1790779358.557337:0:24211:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1790779358.559379:0:24211:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790779358.559644:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1790779358.559651:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790779358.563865:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1790779358.563876:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790779358.567020:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790779358.567035:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790779358.568217:0:24211:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779358.568393:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790779358.568399:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790779358.572313:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790779358.572326:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:2.0:1790779358.573010:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779358.620851:0:24211:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790779358.621146:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790779358.621156:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790779358.623777:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790779358.623794:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1790779358.625290:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790779358.625302:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790779358.628621:0:24211:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790779358.628813:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790779358.628819:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1790779358.636425:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1790779358.636441:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790779358.683241:0:24211:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790779358.683527:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790779358.683533:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790779358.685029:0:24211:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790779358.685041:0:24211:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790779358.685709:0:24211:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790779358.685739:0:24211:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1790779358.685746:0:24211:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790779358.705641:0:24211:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790779358.705682:0:24211:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.103@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790779358.705687:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790779358.705689:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790779358.705691:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779358.705692:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779358.705693:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779358.705694:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779358.705696:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779358.705698:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779358.705700:0:24211:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779358.705703:0:24211:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790779358.705706:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790779358.705707:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790779358.705708:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779358.705709:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779358.705711:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779358.705712:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779358.705713:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779358.705714:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779358.705714:0:24211:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779358.705754:0:24211:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790779358.705778:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790779358.705858:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779358.706093:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711f8acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779358.706765:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663890176 00000100:00100000:1.0:1790779358.706777:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663890176 00000100:00100000:1.0:1790779358.706927:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790779358.706939:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+18:24211:x1877767663890176:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790779358.707001:0:22703:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790779358.707005:0:22703:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1790779358.707009:0:22703:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1790779358.707728:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+18:24211:x1877767663890176:12345-0@lo:253:mount.lustre.0 Request processed in 790us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779358.707737:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790779358.709341:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790779358.709358:0:24211:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790779358.709362:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790779358.709363:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790779358.709365:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779358.709366:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779358.709367:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779358.709368:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779358.709370:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779358.709372:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779358.709381:0:24211:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790779358.709409:0:24211:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b7603bd9000 from lustre-OST0000 10000000:01000000:2.0:1790779358.709440:0:24211:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790779358.709442:0:24211:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790779358.709450:0:24211:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b7734098000 local copy 00010000:00010000:2.0:1790779358.709461:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779358.709566:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779358.709622:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779358.709669:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711f8a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779358.709843:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663890304 00000100:00100000:3.0:1790779358.709851:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663890304 00000100:00100000:3.0:1790779358.709939:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790779358.709948:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+18:24211:x1877767663890304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779358.710043:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+18:24211:x1877767663890304:12345-0@lo:501:mount.lustre.0 Request processed in 96us (420us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790779358.710051:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790779358.710280:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890304:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790779358.710293:0:24211:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790779358.710312:0:24211:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790779358.710319:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779358.710328:0:24211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779358.710360:0:24211:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b7603bd9000 10000000:01000000:2.0:1790779358.710364:0:24211:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790779358.710368:0:24211:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790779358.710370:0:24211:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790779358.711387:0:24211:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790779358.711393:0:24211:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790779358.711428:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936e739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.711438:0:24211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936e739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.711447:0:24211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936e739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779358.711468:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790779358.711530:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.711576:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711cd6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790779358.711765:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663890432 00000100:00100000:1.0:1790779358.711773:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663890432 00000100:00100000:1.0:1790779358.711820:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790779358.711829:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+18:24211:x1877767663890432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779358.711840:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779358.711851:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7603be7600/0xb1aa4014e936e740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e739 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.711873:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be7600/0xb1aa4014e936e740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e739 expref: 19 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.711910:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7603be7600/0xb1aa4014e936e740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e739 expref: 19 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.711935:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7600, rc 0) 00000100:00100000:1.0:1790779358.711984:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+19:24211:x1877767663890432:12345-0@lo:101:mount.lustre.0 Request processed in 157us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779358.711991:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790779358.712118:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779358.712142:0:24211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936e739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e740 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779358.712150:0:24211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936e739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e740 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790779358.713746:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1790779358.715023:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790779358.717488:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1790779358.717599:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1790779358.717621:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1790779358.717638:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1790779358.717651:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1790779358.717663:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1790779358.717677:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1790779358.717691:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1790779358.717705:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1790779358.717719:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1790779358.717734:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1790779358.717748:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1790779358.717775:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1790779358.717789:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1790779358.718055:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779358.718257:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779358.718361:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa5300 going to sleep for 11 seconds 00000100:00100000:1.0:1790779358.723987:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663890560 00000100:00100000:1.0:1790779358.724000:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663890560 00000100:00100000:1.0:1790779358.724075:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790779358.724085:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+19:24211:x1877767663890560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779358.724530:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+19:24211:x1877767663890560:12345-0@lo:501:mount.lustre.0 Request processed in 446us (6272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779358.724540:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790779358.724661:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779358.724736:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779358.724786:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.724835:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711cd6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790779358.724936:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663890688 00000100:00100000:1.0:1790779358.724942:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663890688 00000100:00100000:1.0:1790779358.725007:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790779358.725015:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+19:24211:x1877767663890688:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779358.725791:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+19:24211:x1877767663890688:12345-0@lo:503:mount.lustre.0 Request processed in 774us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779358.725800:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790779358.725922:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890688:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790779358.726747:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790779358.726844:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779358.726946:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.730603:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027f1540 going to sleep for 11 seconds 00000100:00100000:2.0:1790779358.732836:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663890816 00000100:00100000:2.0:1790779358.732852:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663890816 00000100:00100000:3.0:1790779358.736489:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790779358.736503:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+19:24211:x1877767663890816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779358.737279:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+19:24211:x1877767663890816:12345-0@lo:502:mount.lustre.0 Request processed in 776us (10331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.737289:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790779358.737499:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779358.737756:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1790779358.737789:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1790779358.737803:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1790779358.737816:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1790779358.737828:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1790779358.737840:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1790779358.737855:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1790779358.737870:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1790779358.737930:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1790779358.737946:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1790779358.737958:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1790779358.737970:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1790779358.738010:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779358.738061:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779358.738094:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779358.738202:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663890944 00000100:00100000:1.0:1790779358.738209:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663890944 00000100:00100000:1.0:1790779358.738249:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790779358.738258:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+19:24211:x1877767663890944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779358.738363:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+19:24211:x1877767663890944:12345-0@lo:502:mount.lustre.0 Request processed in 106us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779358.738371:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790779358.738715:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663890944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779358.738763:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1790779358.738772:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1790779358.739926:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790779358.739938:0:24228:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1790779358.739946:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779358.739948:0:24228:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790779358.739955:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790779358.739974:0:24228:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b7727434d40) 00000020:00000080:0.0:1790779358.740011:0:24228:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790779358.740020:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790779358.740117:0:24228:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b7603bd9000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790779358.740127:0:24228:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790779358.740144:0:24228:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb1aa4014e936e74e 00010000:00010000:0.0:1790779358.745739:0:24228:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1790779358.746532:0:24228:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1790779358.748927:0:24228:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1790779358.750384:0:24228:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790779358.750399:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779358.750406:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779358.750409:0:24228:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790779358.750413:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790779358.750416:0:24228:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1790779358.750418:0:24228:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790779358.750420:0:24228:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790779358.750421:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790779358.750424:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779358.750426:0:24228:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790779358.750428:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779358.750432:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779358.750433:0:24228:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790779358.750436:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790779358.750438:0:24228:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790779358.750440:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779358.750442:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779358.750443:0:24228:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790779358.750446:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779358.750447:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779358.750448:0:24228:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790779358.750451:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790779358.750479:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779358.750482:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779358.750483:0:24228:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790779358.750493:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1790779358.750771:0:24211:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790779358.750804:0:24211:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790779358.750829:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936e739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e740 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779358.750841:0:24211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894ba00/0xb1aa4014e936e739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e740 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779358.750849:0:24211:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7603bd9000 from 1 10000000:01000000:0.0:1790779358.750852:0:24211:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790779358.750920:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779358.750929:0:24211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779358.750942:0:24211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779358.750967:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790779358.751047:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779358.751093:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81480 going to sleep for 11 seconds 00000100:00100000:3.0:1790779358.752485:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663891072 00000100:00100000:3.0:1790779358.752496:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663891072 00000100:00100000:3.0:1790779358.752550:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790779358.752561:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+19:24211:x1877767663891072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779358.752577:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779358.752593:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936e75c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e755 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.752616:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936e75c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e755 expref: 20 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.752628:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936e75c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e755 expref: 20 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.752638:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894ae00, rc 0) 00000100:00100000:3.0:1790779358.752721:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+20:24211:x1877767663891072:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.752728:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790779358.753302:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779358.753323:0:24211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779358.753333:0:24211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779358.756331:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1790779358.756686:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790779358.756942:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1790779358.756971:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1790779358.756987:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1790779358.757003:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1790779358.757017:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1790779358.757032:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1790779358.757046:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1790779358.757059:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1790779358.757073:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1790779358.757088:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1790779358.760607:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1790779358.760699:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1790779358.760706:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1790779358.760819:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779358.762499:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779358.765009:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711f8aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779358.766486:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663891200 00000100:00100000:3.0:1790779358.766500:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663891200 00000100:00100000:3.0:1790779358.766621:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790779358.766642:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+20:24211:x1877767663891200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779358.767083:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+20:24211:x1877767663891200:12345-0@lo:501:mount.lustre.0 Request processed in 445us (4593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.767091:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790779358.767174:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779358.767288:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779358.767338:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.767383:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76035bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1790779358.767499:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663891328 00000100:00100000:1.0:1790779358.767506:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663891328 00000100:00100000:1.0:1790779358.767543:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790779358.767551:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+20:24211:x1877767663891328:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779358.767650:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+20:24211:x1877767663891328:12345-0@lo:503:mount.lustre.0 Request processed in 99us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779358.767658:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790779358.767953:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891328:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790779358.768443:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790779358.768527:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779358.768597:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779358.768624:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711f8a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779358.768720:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663891456 00000100:00100000:3.0:1790779358.768727:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663891456 00000100:00100000:3.0:1790779358.768773:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790779358.768784:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+20:24211:x1877767663891456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779358.769083:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+20:24211:x1877767663891456:12345-0@lo:502:mount.lustre.0 Request processed in 300us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.769092:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790779358.769164:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790779358.769361:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790779358.769471:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1790779358.769488:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1790779358.769503:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1790779358.769515:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1790779358.769527:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1790779358.769539:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1790779358.769551:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1790779358.769565:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1790779358.769576:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1790779358.769586:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1790779358.769607:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779358.769642:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779358.769673:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711f8a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779358.769738:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663891584 00000100:00100000:3.0:1790779358.769743:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663891584 00000100:00100000:3.0:1790779358.769837:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790779358.769845:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+20:24211:x1877767663891584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779358.769953:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+20:24211:x1877767663891584:12345-0@lo:502:mount.lustre.0 Request processed in 109us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.769961:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790779358.770686:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790779358.770737:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1790779358.770746:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790779358.775477:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779358.775557:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779358.775561:0:24232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790779358.775569:0:24232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b7603bd9000 00000020:00000080:0.0:1790779358.775572:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790779358.775580:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779358.775582:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779358.775583:0:24232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790779358.775585:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779358.775587:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779358.775588:0:24232:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790779358.775591:0:24232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b7603bd9000 00000020:00000080:0.0:1790779358.775592:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790779358.775703:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779358.775707:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779358.775708:0:24232:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790779358.775710:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779358.775713:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779358.775714:0:24232:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790779358.775718:0:24232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b7603bd9000 00000020:00000080:0.0:1790779358.775720:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790779358.779857:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779358.779869:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779358.779871:0:24232:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790779358.779876:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790779358.779895:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779358.779898:0:24232:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790779358.779904:0:24232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b7603bd9000 00000020:00000080:0.0:1790779358.779906:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790779358.779971:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790779358.779975:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779358.779976:0:24232:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790779358.779979:0:24232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1790779358.780065:0:24211:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790779358.780106:0:24211:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790779358.780141:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.780160:0:24211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779358.780632:0:24211:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790779358.780637:0:24211:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b7603bd9000 10000000:01000000:3.0:1790779358.780640:0:24211:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b7603bd9000 10000000:01000000:3.0:1790779358.780645:0:24211:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790779358.780651:0:24211:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b7603bd9000 from 1 10000000:01000000:3.0:1790779358.780655:0:24211:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790779358.780692:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b800/0xb1aa4014e936e763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.780702:0:24211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894b800/0xb1aa4014e936e763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.780713:0:24211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894b800/0xb1aa4014e936e763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779358.780873:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790779358.780971:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.781027:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76035bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1790779358.781188:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663891712 00000100:00100000:2.0:1790779358.781198:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663891712 00000100:00100000:2.0:1790779358.781604:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790779358.781616:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+20:24211:x1877767663891712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779358.781630:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779358.781644:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7602670600/0xb1aa4014e936e76a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e763 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779358.781682:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7602670600/0xb1aa4014e936e76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e763 expref: 21 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779358.781694:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7602670600/0xb1aa4014e936e76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e763 expref: 21 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779358.781704:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602670600, rc 0) 00000100:00100000:2.0:1790779358.781760:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663891712:12345-0@lo:101:mount.lustre.0 Request processed in 147us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779358.781768:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790779358.781783:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779358.781804:0:24211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894b800/0xb1aa4014e936e763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e76a expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.781814:0:24211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894b800/0xb1aa4014e936e763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e76a expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790779358.788195:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1790779358.789754:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790779358.790000:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1790779358.790024:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1790779358.790036:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1790779358.790047:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1790779358.790058:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1790779358.790069:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1790779358.790080:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1790779358.790091:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1790779358.790608:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1790779358.790625:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1790779358.790637:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1790779358.790647:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1790779358.790659:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1790779358.790670:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1790779358.790696:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1790779358.790711:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1790779358.790724:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1790779358.790738:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1790779358.790750:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1790779358.790763:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1790779358.790775:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1790779358.790788:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1790779358.790801:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1790779358.790814:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1790779358.790828:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1790779358.790841:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1790779358.790854:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1790779358.790867:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1790779358.790904:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1790779358.790929:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1790779358.790953:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1790779358.790969:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1790779358.790982:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1790779358.790996:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1790779358.791009:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1790779358.791022:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1790779358.791033:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1790779358.791047:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1790779358.791059:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1790779358.791071:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1790779358.791083:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1790779358.791097:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1790779358.792330:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1790779358.792347:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1790779358.792362:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1790779358.793082:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1790779358.793213:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1790779358.793231:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1790779358.795335:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1790779358.796240:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1790779358.796283:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1790779358.796290:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1790779358.796437:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779358.796517:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.796574:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76035bdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779358.796635:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663891840 00000100:00100000:2.0:1790779358.796643:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663891840 00000100:00100000:2.0:1790779358.796699:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790779358.796709:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663891840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779358.796838:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663891840:12345-0@lo:501:mount.lustre.0 Request processed in 130us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779358.796845:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790779358.798097:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779358.798154:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779358.798214:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.798259:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76035bdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779358.798285:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663891968 00000100:00100000:3.0:1790779358.798291:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663891968 00000100:00100000:3.0:1790779358.798352:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790779358.798362:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663891968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779358.799762:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663891968:12345-0@lo:503:mount.lustre.0 Request processed in 1394us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.799775:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790779358.799973:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663891968:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790779358.800452:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790779358.800545:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663892096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779358.800595:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779358.800634:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78900 going to sleep for 11 seconds 00000100:00100000:3.0:1790779358.800650:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663892096 00000100:00100000:3.0:1790779358.800657:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663892096 00000100:00100000:3.0:1790779358.800704:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790779358.800712:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663892096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779358.800815:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663892096:12345-0@lo:502:mount.lustre.0 Request processed in 103us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.800828:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790779358.800872:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663892096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779358.801089:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1790779358.801121:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1790779358.801149:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1790779358.801166:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1790779358.801181:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1790779358.801196:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1790779358.801215:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1790779358.801229:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1790779358.801243:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1790779358.801257:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1790779358.801271:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1790779358.801288:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1790779358.801318:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1790779358.801360:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1790779358.801378:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1790779358.801395:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1790779358.802578:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1790779358.802610:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1790779358.802644:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1790779358.802662:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1790779358.802679:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1790779358.802695:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1790779358.802710:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1790779358.802725:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1790779358.802739:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1790779358.802755:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1790779358.802774:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1790779358.802792:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1790779358.802809:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1790779358.802826:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1790779358.802842:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1790779358.802859:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1790779358.802903:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1790779358.802925:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1790779358.802958:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1790779358.803095:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1790779358.803138:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1790779358.803164:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1790779358.803187:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1790779358.803213:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1790779358.803236:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1790779358.803254:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1790779358.803269:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1790779358.803285:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1790779358.803517:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1790779358.803543:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1790779358.803574:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1790779358.803597:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1790779358.803661:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663892224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779358.803743:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.803798:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663892224 00000100:00100000:3.0:1790779358.803806:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663892224 00000100:00100000:3.0:1790779358.803860:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790779358.803870:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663892224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779358.804540:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663892224:12345-0@lo:502:mount.lustre.0 Request processed in 671us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.804549:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790779358.804632:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77343d9480 going to sleep for 11 seconds 00000100:00100000:3.0:1790779358.804659:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663892224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779358.804849:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1790779358.804909:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1790779358.804940:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663892352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779358.804998:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.805044:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77343d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1790779358.805546:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663892352 00000100:00100000:1.0:1790779358.805554:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663892352 00000100:00100000:1.0:1790779358.805602:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790779358.805610:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663892352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779358.805714:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663892352:12345-0@lo:502:mount.lustre.0 Request processed in 103us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779358.805722:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790779358.805754:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663892352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779358.805804:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1790779358.805814:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790779358.807275:0:24238:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790779358.807293:0:24238:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b77041cb380) 00000020:00000080:3.0:1790779358.807494:0:24238:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1790779358.807594:0:24238:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b7603bd9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790779358.807600:0:24238:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b7603bd9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790779358.807603:0:24238:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b7603bd9000 3 00010000:00080000:3.0:1790779358.807642:0:24238:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b771828c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.103@tcp at head 00010000:00010000:3.0:1790779358.810811:0:24238:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1790779358.811208:0:24238:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790779358.811256:0:24238:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790779358.811270:0:24238:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb1aa4014e936e778 00000100:00080000:3.0:1790779358.811281:0:24238:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790779358.811293:0:24238:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b771828c000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779358.811667:0:24238:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603832d80 x1877767663892480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790779358.811698:0:24238:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:3.0:1790779358.811956:0:24238:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790779358.812095:0:24238:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9b77041c8000) 00000020:00000080:3.0:1790779358.812113:0:24238:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1790779358.812212:0:24238:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b7603bd9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790779358.812216:0:24238:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b7603bd9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790779358.812220:0:24238:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b7603bd9000 3 00010000:00080000:3.0:1790779358.812250:0:24238:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7707eda800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.103@tcp at head 00000100:00100000:0.0:1790779358.812275:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663892480:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790779358.812350:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779358.812429:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663892480 00000100:00100000:0.0:1790779358.812437:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663892480 00000100:00100000:0.0:1790779358.812465:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790779358.812472:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663892480:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790779358.812498:0:22713:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:0.0:1790779358.812529:0:22713:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb1aa4014e936e786 00000004:00100000:0.0:1790779358.812543:0:22713:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790779358.812574:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9b76038f7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779358.812625:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1877767663892480:12345-0@lo:38:llog_process_th.0 Request processed in 152us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779358.812632:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790779358.812669:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7603832d80 x1877767663892480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779358.812680:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790779358.812688:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1790779358.812695:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790779358.812698:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790779358.812701:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b771828c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790779358.812707:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1877767663892480:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1790779358.813165:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779358.813940:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779358.813944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779358.813953:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779358.813989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779358.813992:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779358.813994:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779358.813997:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790779358.814033:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663892608:0@lo:400:kworker.0 00000100:00100000:2.0:1790779358.814081:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779358.814113:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779358.814120:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663892992:0@lo:400:kworker.0 00000100:00100000:2.0:1790779358.814156:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790779358.814819:0:24238:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1790779358.815433:0:24238:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1790779358.815476:0:24238:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790779358.815490:0:24238:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb1aa4014e936e78d 00000100:00080000:3.0:1790779358.815498:0:24238:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790779358.815508:0:24238:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9b7707eda800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:3.0:1790779358.815537:0:24238:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7603831500 x1877767663893120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790779358.815576:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1877767663893120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790779358.815624:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.815688:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663892992 00000100:00100000:3.0:1790779358.815702:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663892992 00000100:00100000:3.0:1790779358.815738:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663893120 00000100:00100000:3.0:1790779358.815742:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663893120 00000100:00100000:3.0:1790779358.815755:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790779358.815763:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663892992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779358.815812:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663892992:12345-0@lo:400:kworker.0 Request processed in 49us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.815819:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790779358.815833:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790779358.815837:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663893120:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790779358.815858:0:22713:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:3.0:1790779358.815919:0:22713:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb1aa4014e936e794 00000004:00100000:3.0:1790779358.815932:0:22713:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790779358.815960:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9b7711491000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790779358.816004:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1877767663893120:12345-0@lo:38:llog_process_th.0 Request processed in 164us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.816011:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790779358.816044:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7603831500 x1877767663893120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779358.816053:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790779358.816060:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1790779358.816067:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790779358.816070:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1790779358.816073:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7707eda800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790779358.816078:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1877767663893120:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1790779358.816095:0:24238:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1790779358.817225:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663892864:0@lo:400:kworker.0 00000100:00100000:3.0:1790779358.817268:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.817311:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790779358.817318:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663892736:0@lo:400:kworker.0 00000100:00100000:3.0:1790779358.817370:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.817429:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663892608 00000100:00100000:3.0:1790779358.817435:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663892608 00000100:00100000:3.0:1790779358.817461:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663892864 00010000:00080000:2.0:1790779358.817463:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7735c17800 x1877767663892992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779358.817465:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663892864 00000100:00100000:2.0:1790779358.817479:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663892992:0@lo:400:kworker.0 00000100:00100000:3.0:1790779358.817485:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790779358.817495:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663892608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779358.817519:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663892736 00000100:00100000:2.0:1790779358.817524:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663892736 00000100:00100000:3.0:1790779358.817549:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663892608:12345-0@lo:400:kworker.0 Request processed in 53us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779358.817557:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779358.817559:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790779358.817569:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663892736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779358.817580:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790779358.817589:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663892864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779358.817622:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663892736:12345-0@lo:400:kworker.0 Request processed in 54us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779358.817629:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779358.817635:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663892864:12345-0@lo:400:kworker.0 Request processed in 45us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.817643:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1790779358.817659:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779358.817665:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779358.817669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779358.817680:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779358.817683:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779358.817686:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790779358.817688:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779358.817691:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1790779358.817717:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b7735c14380 x1877767663892736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779358.817727:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663892736:0@lo:400:kworker.0 00000100:00100000:2.0:1790779358.817736:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663892864:0@lo:400:kworker.0 00000100:00100000:2.0:1790779358.817759:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663892608:0@lo:400:kworker.0 00000040:00080000:3.0:1790779358.818690:0:24238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1790779358.819263:0:24211:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790779358.819293:0:24211:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790779358.819317:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894b800/0xb1aa4014e936e763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e76a expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779358.819329:0:24211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894b800/0xb1aa4014e936e763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e76a expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790779358.819393:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790779358.819396:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790779358.819397:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779358.819398:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779358.819400:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779358.819401:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779358.819403:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790779358.819405:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779358.819406:0:24211:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790779358.819410:0:24211:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1790779358.819413:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790779358.819414:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790779358.819415:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790779358.819416:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790779358.819417:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790779358.819418:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790779358.819420:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790779358.819421:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790779358.819422:0:24211:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790779358.819444:0:24211:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790779358.819461:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663893248:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790779358.819516:0:24211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779358.819558:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d81780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779358.819575:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663893248 00000100:00100000:3.0:1790779358.819582:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663893248 00000100:00100000:3.0:1790779358.819630:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790779358.819639:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663893248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790779358.819662:0:22703:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790779358.819675:0:22703:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790779358.824830:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663893376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779358.824989:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.825038:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663893376 00000100:00100000:3.0:1790779358.825051:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663893376 00000100:00100000:3.0:1790779358.825096:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790779358.825105:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663893376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790779358.825146:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790779358.829265:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663893376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4153us (4269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.829278:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790779358.829967:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663893376:0@lo:41:osp-pre-0-1.0 20000000:01000000:0.0:1790779358.830203:0:22703:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790779358.830221:0:22703:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790779358.830645:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+21:24211:x1877767663893248:12345-0@lo:253:mount.lustre.0 Request processed in 11006us (11126us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779358.830655:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790779358.830734:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:24211:1877767663893248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790779358.830746:0:24211:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790779358.830749:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790779358.830751:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790779358.830752:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779358.830753:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779358.830755:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779358.830756:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779358.830758:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779358.830760:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779358.830761:0:24211:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790779358.830774:0:24211:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1790779358.831602:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790779358.831608:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790779358.831626:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.831642:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7603be6a00/0xb1aa4014e936e6e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e6de expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.831650:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e6f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e6ec expref: 20 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.831659:0:22727:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.831693:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e6f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e6ec expref: 20 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.831714:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e6f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e6ec expref: 20 pid: 22703 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779358.831727:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663893504:0@lo:104: 00000100:00100000:1.0:1790779358.831769:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790779358.831828:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7603be6a00/0xb1aa4014e936e6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e6de expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.831835:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7603be6a00/0xb1aa4014e936e6e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e6de expref: 20 pid: 22704 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779358.831843:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663893632:0@lo:104: 00000100:00100000:1.0:1790779358.831894:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779358.831908:0:22727:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c480 going to sleep for 11 seconds 00000100:00100000:3.0:1790779358.833046:0:22694:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790779358.833072:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663893504 00000100:00100000:3.0:1790779358.833080:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663893504 00000100:00100000:3.0:1790779358.833111:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663893632 00000100:00100000:3.0:1790779358.833114:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663893632 00000100:00100000:3.0:1790779358.833140:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779358.833149:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+4:22727:x1877767663893504:12345-0@lo:104: 00010000:00010000:3.0:1790779358.833163:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833361:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790779358.833368:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+4:22727:x1877767663893504:12345-0@lo:104: Request processed in 221us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779358.833476:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663893504:0@lo:104: 00000100:00100000:3.0:1790779358.833508:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779358.833527:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779358.833533:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711396850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+3:22727:x1877767663893632:12345-0@lo:104: 00010000:00010000:3.0:1790779358.833542:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833617:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790779358.833623:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711396850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+3:22727:x1877767663893632:12345-0@lo:104: Request processed in 91us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.833638:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1790779358.833679:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779358.833685:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833692:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779358.833697:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833707:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779358.833713:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779358.833719:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790779358.833748:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833754:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779358.833772:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833780:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be7000/0xb1aa4014e936e6ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e6f3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833792:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779358.833795:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833810:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602670000 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:3.0:1790779358.833813:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833820:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790779358.833825:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779358.833830:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790779358.833842:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833847:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779358.833866:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833873:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7602670000/0xb1aa4014e936e6de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e6e5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.833908:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779358.833910:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779358.833912:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779358.833919:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779358.833940:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663893760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790779358.833977:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.834022:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779358.834029:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663893888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790779358.834065:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779358.834107:0:22698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663893760 00000100:00100000:3.0:1790779358.834111:0:22698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663893760 00010000:00010000:3.0:1790779358.834140:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e6f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e6ec expref: 21 pid: 22703 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779358.834162:0:22698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663893888 00000100:00100000:3.0:1790779358.834165:0:22698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663893888 00010000:00010000:3.0:1790779358.834187:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7603be6a00/0xb1aa4014e936e6e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e6de expref: 22 pid: 22704 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779358.834202:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779358.834209:0:22698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9d73c52-009d-4820-b396-7792bc096088+22:3649:x1877767663893760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779358.835017:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779358.835027:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e6f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e6ec expref: 22 pid: 22703 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835040:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e6f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e6ec expref: 22 pid: 22703 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835057:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e6f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e6ec expref: 22 pid: 22703 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835072:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779358.835125:0:22698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9d73c52-009d-4820-b396-7792bc096088+21:3649:x1877767663893760:12345-0@lo:103:ldlm_bl.0 Request processed in 916us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.835141:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779358.835161:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779358.835180:0:22698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760316cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9d73c52-009d-4820-b396-7792bc096088+20:3649:x1877767663893888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779358.835200:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779358.835206:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7603be6a00/0xb1aa4014e936e6e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e6de expref: 20 pid: 22704 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835226:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7603be6a00/0xb1aa4014e936e6e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e6de expref: 20 pid: 22704 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835240:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835249:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790779358.835264:0:22698:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012562762s 00010000:00010000:3.0:1790779358.835269:0:22698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835277:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835285:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835292:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835298:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779358.835302:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835309:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835324:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779358.835333:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779358.835361:0:22698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760316cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9d73c52-009d-4820-b396-7792bc096088+20:3649:x1877767663893888:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779358.835367:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790779358.835640:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663893888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790779358.835650:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663893760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790779358.837390:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7603be6a00/0xb1aa4014e936e6e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e6de expref: 19 pid: 22704 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779358.837407:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663893632:0@lo:104: 00010000:00010000:1.0:1790779358.837429:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.837438:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.837444:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779358.837459:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936e79b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1790779358.839313:0:24211:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1790779358.846050:0:24211:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790779358.846059:0:24211:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790779358.846108:0:24211:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790779358.846160:0:24211:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790779358.846183:0:24211:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790779358.846202:0:24211:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1790779358.849335:0:24211:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790779358.849759:0:24211:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790779359.338179:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663894016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779359.338246:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779359.338389:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663894016 00000100:00100000:1.0:1790779359.338397:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663894016 00000100:00100000:1.0:1790779359.338478:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790779359.338488:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663894016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790779359.338521:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790779359.338579:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663894016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779359.338588:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790779359.338654:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663894016:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790779359.595752:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790779359.743289:0:24290:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790779359.743535:0:24290:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1790779360.168001:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790779360.168009:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b770ea1b000 from 13 10000000:01000000:2.0:1790779360.168015:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790779360.168069:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779360.168082:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779360.168103:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779360.168139:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663894144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790779360.168211:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779360.168253:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7712633b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790779360.168368:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663894144 00000100:00100000:3.0:1790779360.168377:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663894144 00000100:00100000:3.0:1790779360.168430:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790779360.168439:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+19:22707:x1877767663894144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779360.168453:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779360.168466:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e7a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e7a2 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779360.168487:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e7a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e7a2 expref: 20 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779360.168511:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e7a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e7a2 expref: 20 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779360.168520:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894a000, rc 0) 00000100:00100000:3.0:1790779360.168572:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+20:22707:x1877767663894144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779360.168579:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790779360.168674:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663894144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779360.168688:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779360.168697:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779360.168746:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663894272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790779360.168778:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779360.168924:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7712633b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790779360.174278:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663894272 00000100:00100000:3.0:1790779360.174294:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663894272 00000100:00100000:3.0:1790779360.175019:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790779360.175032:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+20:22707:x1877767663894272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790779360.175068:0:22703:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790779360.175085:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790779360.175098:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1790779360.175259:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+20:22707:x1877767663894272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 231us (6480us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779360.175267:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790779360.178614:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663894272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790779360.178695:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790779360.178705:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779360.178718:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779360.178729:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790779360.178731:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b773c016000 from 13 10000000:01000000:0.0:1790779360.178734:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790779360.178766:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779360.178773:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779360.178783:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779360.178803:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663894400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779360.178858:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779360.180295:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790779360.180337:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663894400 00000100:00100000:2.0:1790779360.180346:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663894400 00000100:00100000:2.0:1790779360.180442:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790779360.180451:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+20:22707:x1877767663894400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779360.180481:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779360.180496:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e7b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e7b0 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779360.180522:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e7b0 expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779360.180532:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e7b0 expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779360.180541:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602671200, rc 0) 00000100:00100000:2.0:1790779360.180648:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:22707:x1877767663894400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779360.180654:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790779360.180731:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663894400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779360.180748:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779360.180757:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779360.180823:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663894528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790779360.180859:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779360.180951:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779360.181029:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663894528 00000100:00100000:3.0:1790779360.181035:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663894528 00000100:00100000:2.0:1790779360.181196:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790779360.181205:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:22707:x1877767663894528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790779360.181219:0:22705:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790779360.181236:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790779360.181240:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1790779360.181321:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:22707:x1877767663894528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779360.181328:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790779360.181430:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663894528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790779360.181483:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790779360.181491:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779360.181500:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779360.621053:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779361.640525:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790779362.024638:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790779362.664045:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779363.689356:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779363.945046:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1790779363.945232:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779363.945238:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779363.945240:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779363.945243:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779363.945258:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779363.945261:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779363.945264:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779363.945267:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790779363.945326:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663894784:0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.945398:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779363.945452:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663895296:0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.945480:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779363.945501:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790779363.945507:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663894912:0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.945545:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779363.945565:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663895424:0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.945591:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779363.945622:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663894784 00000100:00100000:1.0:1790779363.945630:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663894784 00000100:00100000:1.0:1790779363.945674:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790779363.945683:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:3649:x1877767663894784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.945732:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:3649:x1877767663894784:12345-0@lo:400:kworker.0 Request processed in 50us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779363.945740:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790779363.945771:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663895296 00000100:00100000:1.0:1790779363.945774:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663895296 00000100:00100000:1.0:1790779363.945798:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663895424 00000100:00100000:1.0:1790779363.945801:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663895424 00000100:00100000:1.0:1790779363.945825:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790779363.945832:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663895296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.945864:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663895296:12345-0@lo:400:kworker.0 Request processed in 33us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779363.945870:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790779363.945909:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790779363.945917:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663895424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.945945:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663895424:12345-0@lo:400:kworker.0 Request processed in 30us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779363.945963:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790779363.945984:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663894912 00000100:00100000:1.0:1790779363.945989:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663894912 00000100:00100000:1.0:1790779363.946014:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790779363.946021:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663894912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.946056:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663894912:12345-0@lo:400:kworker.0 Request processed in 35us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779363.946265:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1790779363.946309:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779363.946344:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663894912:0@lo:400:kworker.0 00010000:00080000:1.0:1790779363.946360:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a8e00 x1877767663895424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779363.946370:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663895424:0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.946379:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e9d73c52-009d-4820-b396-7792bc096088:3649:1877767663894784:0@lo:400:kworker.0 00010000:00080000:1.0:1790779363.946388:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7ab480 x1877767663895296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779363.946396:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663895296:0@lo:400:kworker.0 00000100:00100000:2.0:1790779363.946603:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663895040:0@lo:400:kworker.0 00000100:00100000:2.0:1790779363.946636:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779363.946654:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663895552:0@lo:400:kworker.0 00000100:00100000:2.0:1790779363.946697:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779363.946710:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663894656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779363.946729:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779363.946745:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790779363.946751:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663895168:0@lo:400:kworker.0 00000100:00100000:2.0:1790779363.946771:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779363.947440:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663894656 00000100:00100000:1.0:1790779363.947446:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663894656 00000100:00100000:1.0:1790779363.947472:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663895168 00000100:00100000:1.0:1790779363.947475:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663895168 00000100:00100000:1.0:1790779363.947487:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790779363.947493:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1877767663894656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779363.947524:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790779363.948449:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1877767663894656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 954us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779363.948458:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790779363.948480:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790779363.948488:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663895168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.948519:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663895168:12345-0@lo:400:kworker.0 Request processed in 33us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779363.948525:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790779363.948620:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663895040 00000100:00100000:1.0:1790779363.948628:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663895040 00000100:00100000:1.0:1790779363.948654:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663895552 00000100:00100000:1.0:1790779363.948657:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663895552 00000100:00100000:1.0:1790779363.948682:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790779363.948687:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663895040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.948718:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663895040:12345-0@lo:400:kworker.0 Request processed in 31us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779363.948724:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790779363.948735:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790779363.948740:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663895552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779363.948764:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1877767663895552:12345-0@lo:400:kworker.0 Request processed in 25us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779363.948769:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1790779363.948782:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779363.948977:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663895168:0@lo:400:kworker.0 00010000:00080000:2.0:1790779363.948993:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a9f80 x1877767663895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779363.949002:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663895040:0@lo:400:kworker.0 00010000:00080000:2.0:1790779363.949012:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a8380 x1877767663895552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779363.949020:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1877767663895552:0@lo:400:kworker.0 00000100:00100000:2.0:1790779363.949036:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663894656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779364.459679:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663895680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790779364.459751:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779364.459814:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663895680 00000100:00100000:0.0:1790779364.459821:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663895680 00000100:00100000:0.0:1790779364.459865:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790779364.459873:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663895680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779364.459926:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790779364.459975:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663895680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779364.459983:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790779364.460027:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663895680:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790779364.712994:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790779365.161529:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1790779365.493460:0:24580:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790779365.738512:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790779366.555820:0:24633:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790779366.556138:0:24633:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779366.760011:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790779367.598534:0:24683:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779367.598775:0:24683:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790779367.786683:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779368.040023:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779353/real 1790779353] req@ffff9b7603745180 x1877767663887872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779368 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779368.040055:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603745180 x1877767663887872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779368 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779368.040075:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779353/real 1790779353] req@ffff9b7603746d80 x1877767663888000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779368 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779368.040088:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603746d80 x1877767663888000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779368 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790779368.040108:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7603908000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779368.040133:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790779368.040137:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663887872:0@lo:8:kworker.0 00000100:00080000:1.0:1790779368.040142:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b772012b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779368.040147:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790779368.040150:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663888000:0@lo:8:kworker.0 00000100:00080000:0.0:1790779368.040295:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779368.040312:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790779368.040315:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779368.040318:0:9333:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790779368.040359:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779368.040361:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790779368.040364:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7603908000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779368.040369:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 671 00000100:00080000:0.0:1790779368.040374:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790779368.040384:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b7603908000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779368.040403:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7711bfa680 x1877767663896320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790779368.040416:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779368.040419:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790779368.040420:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b772012b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790779368.040423:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 671 00000100:00080000:0.0:1790779368.040426:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790779368.040430:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b772012b000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:0.0:1790779368.040440:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7711bf9180 x1877767663896448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790779368.040479:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663896192:0@lo:400:kworker.0 00000100:00100000:0.0:1790779368.040533:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779368.040589:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790779368.040596:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663896064:0@lo:400:kworker.0 00000100:00100000:0.0:1790779368.040620:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779368.040646:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663896832:0@lo:400:kworker.0 00000100:00100000:0.0:1790779368.040672:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779368.040697:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663896192 00000100:00100000:0.0:1790779368.040705:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663896192 00000100:00100000:0.0:1790779368.040744:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790779368.040753:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663896192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779368.040799:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663896192:12345-0@lo:400:kworker.0 Request processed in 47us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779368.040807:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790779368.040858:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663896192:0@lo:400:kworker.0 00000100:00100000:3.0:1790779368.040999:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663895936:0@lo:400:kworker.0 00000100:00100000:3.0:1790779368.041031:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779368.041083:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663896704:0@lo:400:kworker.0 00000100:00100000:3.0:1790779368.041109:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779368.041137:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790779368.041143:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663895808:0@lo:400:kworker.0 00000100:00100000:3.0:1790779368.041168:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779368.041190:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663896576:0@lo:400:kworker.0 00000100:00100000:3.0:1790779368.041210:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779368.041233:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663896064 00000100:00100000:3.0:1790779368.041237:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663896064 00000100:00100000:3.0:1790779368.041259:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663896832 00000100:00100000:3.0:1790779368.041262:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663896832 00000100:00100000:3.0:1790779368.041283:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663896704 00000100:00100000:3.0:1790779368.041286:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663896704 00000100:00100000:3.0:1790779368.041296:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663896576 00000100:00100000:3.0:1790779368.041298:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663896576 00000100:00100000:3.0:1790779368.041309:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790779368.041315:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663896064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779368.041362:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1877767663896064:12345-0@lo:400:kworker.0 Request processed in 46us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779368.041368:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790779368.041381:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790779368.041387:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663896832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779368.041417:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663896832:12345-0@lo:400:kworker.0 Request processed in 30us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779368.041427:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790779368.041439:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790779368.041446:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663896704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779368.041478:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663896704:12345-0@lo:400:kworker.0 Request processed in 33us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779368.041493:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790779368.041506:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790779368.041511:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663896576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779368.041541:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1877767663896576:12345-0@lo:400:kworker.0 Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779368.041546:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790779368.041562:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663895808 00000100:00100000:3.0:1790779368.041566:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663895808 00000100:00100000:3.0:1790779368.041590:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790779368.041596:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+21:3650:x1877767663895808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779368.041626:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+21:3650:x1877767663895808:12345-0@lo:400:kworker.0 Request processed in 30us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779368.041632:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790779368.041665:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663895808:0@lo:400:kworker.0 00010000:00080000:3.0:1790779368.041677:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773f51f480 x1877767663896576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779368.041686:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1877767663896576:0@lo:400:kworker.0 00010000:00080000:3.0:1790779368.041694:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773f51c380 x1877767663896704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779368.041702:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663896704:0@lo:400:kworker.0 00010000:00080000:3.0:1790779368.041726:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7711bfb100 x1877767663896064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779368.041736:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1877767663896064:0@lo:400:kworker.0 00010000:00080000:3.0:1790779368.041754:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773f51dc00 x1877767663896832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779368.041763:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663896832:0@lo:400:kworker.0 00000100:00080000:1.0:1790779368.041956:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790779368.041960:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779368.041973:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663896320:0@lo:8:kworker.0 00000100:00100000:1.0:1790779368.042006:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779368.042039:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7711bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663896448:0@lo:8:kworker.0 00000100:00100000:1.0:1790779368.042069:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779368.042152:0:24216:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663896320 00000100:00100000:2.0:1790779368.042158:0:24216:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663896320 00000100:00100000:2.0:1790779368.042183:0:24216:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663896448 00000100:00100000:2.0:1790779368.042187:0:24216:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663896448 00000100:00100000:2.0:1790779368.042197:0:24216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779368.042202:0:24216:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1877767663896320:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790779368.042226:0:24216:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:2.0:1790779368.042256:0:24216:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936e7be 00002000:00100000:2.0:1790779368.042270:0:24216:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9b7707edc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790779368.042280:0:24216:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1790779368.042283:0:24216:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790779368.042449:0:24216:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1790779368.042474:0:24216:0:(import.c:65:import_set_state_nolock()) ffff9b770411d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779368.042516:0:24216:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1877767663896320:12345-0@lo:8:kworker.0 Request processed in 312us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779368.042522:0:24216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790779368.042535:0:24216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779368.042539:0:24216:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1877767663896448:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790779368.042549:0:24216:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790779368.043391:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663895936 00000100:00100000:0.0:1790779368.043399:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663895936 00000100:00100000:0.0:1790779368.043486:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790779368.043495:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663895936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779368.043560:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663895936:12345-0@lo:400:kworker.0 Request processed in 66us (2527us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779368.043566:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1790779368.043653:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7711bfa680 x1877767663896320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790779388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779368.043664:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790779368.043672:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1790779368.043690:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790779368.043695:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790779368.043698:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7603908000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790779368.043710:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790779368.043716:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663896320:0@lo:8:kworker.0 00000004:00080000:1.0:1790779368.043775:0:23453:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790779368.044097:0:23453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23453:1877767663897088:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1790779368.044138:0:23453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779368.044162:0:23453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c480 going to sleep for 11 seconds 00000100:00100000:1.0:1790779368.044176:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779368.044186:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663896960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779368.044211:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779368.044246:0:24217:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790779368.044254:0:24217:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1790779368.044424:0:24217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663897088 00000100:00100000:1.0:1790779368.044429:0:24217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663897088 00000100:00080000:1.0:1790779368.044465:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779368.044536:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790779368.044544:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23453:x1877767663897088:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1790779368.044787:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663895936:0@lo:400:kworker.0 00000004:00080000:1.0:1790779368.044819:0:23452:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790779368.044931:0:23452:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 686052050636ns, next at 0ns, rc = 0 00080000:00080000:1.0:1790779368.044937:0:23452:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1790779368.045079:0:24219:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663896960 00000100:00100000:1.0:1790779368.045084:0:24219:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663896960 00000100:00100000:1.0:1790779368.045108:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790779368.045114:0:24219:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1877767663896960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790779368.045141:0:24219:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790779368.045189:0:24219:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3651:x1877767663896960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779368.045195:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790779368.045286:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a8e00 x1877767663896960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779368.045301:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663896960:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1790779368.049752:0:23444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1790779368.055843:0:24695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1790779368.055852:0:24695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1790779368.056172:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23453:x1877767663897088:12345-0@lo:7:osp-pre-0-1.0 Request processed in 11624us (12029us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779368.056184:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790779368.063131:0:23453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a8700 x1877767663897088/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790779384 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779368.063151:0:23453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23453:1877767663897088:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1790779368.063167:0:23453:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1790779368.064486:0:23453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23453:1877767663897216:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1790779368.064550:0:23453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779368.065051:0:23453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7704db4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779368.069400:0:24217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663897216 00000100:00100000:0.0:1790779368.069414:0:24217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663897216 00000100:00100000:0.0:1790779368.069472:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790779368.069482:0:24217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23453:x1877767663897216:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1790779368.069515:0:24217:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1790779368.069596:0:24217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23453:x1877767663897216:12345-0@lo:5:osp-pre-0-1.0 Request processed in 116us (5046us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779368.069604:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790779368.069653:0:23453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603832d80 x1877767663897216/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790779384 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779368.069680:0:23453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603832d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23453:1877767663897216:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1790779368.069693:0:23453:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1790779368.069737:0:23453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23453:1877767663897344:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1790779368.069773:0:23453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779368.069792:0:23453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7720aa5540 going to sleep for 11 seconds 00000100:00100000:1.0:1790779368.071402:0:24218:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663897344 00000100:00100000:1.0:1790779368.071411:0:24218:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663897344 00000100:00100000:1.0:1790779368.071459:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790779368.071465:0:24217:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1790779368.071467:0:24218:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23453:x1877767663897344:12345-0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1790779368.071472:0:24217:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:1.0:1790779368.071505:0:24218:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1790779368.083283:0:24216:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3648:x1877767663896448:12345-0@lo:8:kworker.0 Request processed in 40736us (41215us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790779368.083301:0:24216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790779368.084222:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b772012b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790779368.084230:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790779368.084235:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7711bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663896448:0@lo:8:kworker.0 00000001:00080000:1.0:1790779368.105994:0:24212:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1790779368.106011:0:24212:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1790779368.106501:0:24218:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23453:x1877767663897344:12345-0@lo:5:osp-pre-0-1.0 Request processed in 35029us (36721us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1790779368.106515:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790779368.106806:0:23453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773f51d500 x1877767663897344/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790779384 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779368.106819:0:23453:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1790779368.106825:0:23453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23453:1877767663897344:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1790779368.106840:0:23453:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1790779368.106907:0:23453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23453:1877767663897472:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1790779368.106957:0:23453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779368.106985:0:23453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779368.109478:0:22723:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663897472 00000100:00100000:3.0:1790779368.109488:0:22723:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663897472 00000100:00100000:3.0:1790779368.109538:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790779368.109547:0:22723:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23453:x1877767663897472:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790779368.109651:0:22723:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23453:x1877767663897472:12345-0@lo:900:osp-pre-0-1.0 Request processed in 105us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779368.109658:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790779368.109698:0:23453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a8e00 x1877767663897472/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790779384 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779368.109849:0:23453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23453:1877767663897472:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1790779368.808121:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779369.071159:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663897600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779369.071235:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779369.071295:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663897600 00000100:00100000:1.0:1790779369.071303:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663897600 00000100:00100000:1.0:1790779369.071350:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790779369.071360:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663897600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779369.071396:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790779369.071443:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663897600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779369.071451:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790779369.071498:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663897600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779369.576940:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779369.576972:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663897728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779369.577036:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779369.577085:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663897728 00000100:00100000:0.0:1790779369.577094:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663897728 00000100:00100000:0.0:1790779369.577184:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790779369.577194:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663897728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779369.577235:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790779369.577291:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663897728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779369.577297:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790779369.577368:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663897728:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790779369.837570:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779370.855992:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779371.881180:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790779372.267206:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790779372.904008:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790779373.160527:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779373.160534:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779373.160537:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779373.160539:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790779373.160567:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790779373.160571:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790779373.160574:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b772012b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790779373.160594:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:1.0:1790779373.160600:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1790779373.160612:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b772012b000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779373.160634:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773b7a9f80 x1877767663898496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779373.160685:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663897856:0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.160749:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.160795:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663898368:0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.160822:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.160847:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790779373.160853:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663897984:0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.160895:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.160917:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663898624:0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.160942:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.160972:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663898112:0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.161008:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.161043:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663898752:0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.161066:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.161082:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790779373.161089:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663898240:0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.161108:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.161123:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663898880:0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.161148:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.161173:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663897856 00000100:00100000:1.0:1790779373.161187:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663897856 00000100:00100000:1.0:1790779373.161232:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790779373.161240:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+21:3651:x1877767663897856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.161285:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+21:3651:x1877767663897856:12345-0@lo:400:kworker.0 Request processed in 46us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779373.161293:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790779373.161326:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663898624 00000100:00100000:1.0:1790779373.161330:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663898624 00000100:00100000:1.0:1790779373.161348:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663898112 00000100:00100000:1.0:1790779373.161350:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663898112 00000100:00100000:1.0:1790779373.161360:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663898752 00000100:00100000:1.0:1790779373.161362:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663898752 00000100:00100000:1.0:1790779373.161380:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663898880 00000100:00100000:1.0:1790779373.161383:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663898880 00000100:00100000:1.0:1790779373.161398:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790779373.161404:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663898624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.161434:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663898624:12345-0@lo:400:kworker.0 Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779373.161440:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790779373.161452:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790779373.161457:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663898112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.161489:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663898112:12345-0@lo:400:kworker.0 Request processed in 31us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779373.161495:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790779373.161506:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790779373.161512:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663898752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.161536:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663898752:12345-0@lo:400:kworker.0 Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779373.161549:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790779373.161562:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790779373.161567:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663898880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.161594:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663898880:12345-0@lo:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779373.161599:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1790779373.161616:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790779373.161620:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779373.161630:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663898496:0@lo:8:kworker.0 00000100:00100000:1.0:1790779373.161653:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.161678:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663898368 00000100:00100000:1.0:1790779373.161681:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663898368 00000100:00100000:1.0:1790779373.161704:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663898496 00000100:00100000:1.0:1790779373.161706:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663898496 00000100:00100000:1.0:1790779373.161717:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790779373.161722:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663898368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.161748:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663898368:12345-0@lo:400:kworker.0 Request processed in 26us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779373.161753:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790779373.161762:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790779373.161765:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1877767663898496:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790779373.161781:0:24695:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790779373.161806:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1877767663898496:12345-0@lo:8:kworker.0 Request processed in 39us (152us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790779373.161811:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790779373.161824:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790779373.161851:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b772012b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779373.161856:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790779373.161859:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663898496:0@lo:8:kworker.0 00010000:00080000:1.0:1790779373.161905:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7603746d80 x1877767663898880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779373.161916:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663898880:0@lo:400:kworker.0 00010000:00080000:1.0:1790779373.161925:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a8e00 x1877767663898112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779373.161932:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663898112:0@lo:400:kworker.0 00010000:00080000:1.0:1790779373.161939:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a9180 x1877767663898752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779373.161946:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663898752:0@lo:400:kworker.0 00010000:00080000:1.0:1790779373.161972:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7abb80 x1877767663898624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779373.161980:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663898624:0@lo:400:kworker.0 00000100:00100000:1.0:1790779373.161988:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663897856:0@lo:400:kworker.0 00010000:00080000:1.0:1790779373.161996:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b7a8380 x1877767663898368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779373.162003:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663898368:0@lo:400:kworker.0 00000100:00100000:3.0:1790779373.164386:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663897984 00000100:00100000:3.0:1790779373.164396:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663897984 00000100:00100000:3.0:1790779373.164431:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663898240 00000100:00100000:3.0:1790779373.164435:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663898240 00000100:00100000:3.0:1790779373.164452:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790779373.164460:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663897984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779373.164563:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663897984:12345-0@lo:400:kworker.0 Request processed in 102us (3683us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779373.164570:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790779373.164587:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790779373.164593:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663898240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779373.164632:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663898240:12345-0@lo:400:kworker.0 Request processed in 39us (3522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779373.164638:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790779373.164664:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779373.164675:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663899008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779373.164706:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779373.164740:0:24219:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663899008 00000100:00100000:3.0:1790779373.164744:0:24219:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663899008 00000100:00100000:3.0:1790779373.164773:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790779373.164790:0:24219:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663899008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790779373.164810:0:24219:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790779373.164842:0:24219:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663899008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779373.164847:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790779373.164875:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773b76a300 x1877767663899008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779373.164912:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663899008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790779373.164938:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663898240:0@lo:400:kworker.0 00000100:00100000:2.0:1790779373.165289:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663897984:0@lo:400:kworker.0 00000020:01000004:2.0:1790779373.486467:0:25030:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790779373.486471:0:25030:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790779373.486472:0:25030:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790779373.486723:0:25030:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b770411d000 00000020:01000004:2.0:1790779373.486740:0:25030:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790779373.486754:0:25030:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790779373.486769:0:25030:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b7726b699c0) 00000020:00000080:2.0:1790779373.486787:0:25030:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790779373.577813:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1790779373.585613:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1790779373.588222:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790779373.588844:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790779373.590626:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790779373.591277:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790779373.591705:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1790779373.592789:0:25030:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790779373.593084:0:25030:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790779373.593100:0:25030:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790779373.593112:0:25030:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb1aa4014e936e7cc 00000020:01000004:2.0:1790779373.593119:0:25030:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790779373.593141:0:25030:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790779373.593145:0:25030:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790779373.593151:0:25030:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790779373.593458:0:25030:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1790779373.593463:0:25030:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790779373.620108:0:25030:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790779373.620154:0:25030:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.103@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790779373.620159:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790779373.620265:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790779373.620267:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779373.620268:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779373.620269:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779373.620271:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779373.620272:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779373.620275:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779373.620276:0:25030:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779373.620280:0:25030:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790779373.620282:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790779373.620283:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790779373.620285:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779373.620361:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779373.620363:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779373.620364:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779373.620365:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779373.620366:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779373.620368:0:25030:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790779373.620405:0:25030:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790779373.620427:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899136:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790779373.620499:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779373.620603:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7718764300 going to sleep for 11 seconds 00000100:00100000:3.0:1790779373.622909:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663899136 00000100:00100000:3.0:1790779373.622923:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663899136 00000100:00100000:3.0:1790779373.623131:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790779373.623143:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:25030:x1877767663899136:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790779373.623194:0:22705:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790779373.623198:0:22705:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1790779373.623202:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790779373.625032:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:25030:x1877767663899136:12345-0@lo:253:mount.lustre.0 Request processed in 1876us (4517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779373.625305:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899136:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790779373.625335:0:25030:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790779373.625339:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790779373.625340:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790779373.625341:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779373.625343:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779373.625344:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779373.625345:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779373.625346:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779373.625349:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779373.625350:0:25030:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790779373.625371:0:25030:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b770411d000 from lustre-OST0001 10000000:01000000:2.0:1790779373.625403:0:25030:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790779373.625406:0:25030:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790779373.625414:0:25030:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b7734098000 local copy 00010000:00010000:2.0:1790779373.625425:0:25030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779373.625521:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779373.625562:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779373.625595:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7718764c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790779373.625953:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663899264 00000100:00100000:1.0:1790779373.625961:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663899264 00000100:00100000:1.0:1790779373.626003:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790779373.626012:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663899264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779373.626102:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663899264:12345-0@lo:501:mount.lustre.0 Request processed in 90us (539us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790779373.626110:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790779373.626513:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899264:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790779373.626530:0:25030:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790779373.626550:0:25030:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790779373.626557:0:25030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.626568:0:25030:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be7200/0xb1aa4014e936e4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e4ed expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779373.626596:0:25030:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b770411d000 10000000:01000000:2.0:1790779373.626609:0:25030:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790779373.626614:0:25030:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790779373.626616:0:25030:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790779373.626620:0:25030:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790779373.626624:0:25030:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790779373.626645:0:25030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671c00/0xb1aa4014e936e7d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.626654:0:25030:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7602671c00/0xb1aa4014e936e7d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.626663:0:25030:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7602671c00/0xb1aa4014e936e7d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779373.626676:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790779373.626706:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779373.626738:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7718764c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779373.626812:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663899392 00000100:00100000:0.0:1790779373.626817:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663899392 00000100:00100000:0.0:1790779373.626840:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790779373.626847:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663899392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779373.626856:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779373.626867:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e7da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e7d3 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.626912:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e7da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e7d3 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.626930:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b76034ae400/0xb1aa4014e936e7da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e7d3 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.626939:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76034ae400, rc 0) 00000100:00100000:0.0:1790779373.626975:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+23:25030:x1877767663899392:12345-0@lo:101:mount.lustre.0 Request processed in 129us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779373.626980:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790779373.627129:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779373.627143:0:25030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7602671c00/0xb1aa4014e936e7d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7da expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.627151:0:25030:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7602671c00/0xb1aa4014e936e7d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e7da expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779373.628454:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1790779373.629703:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790779373.631824:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000040:00080000:2.0:1790779373.635685:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1790779373.635745:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1790779373.635764:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1790779373.635781:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1790779373.635811:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1790779373.635827:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1790779373.635844:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1790779373.635858:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1790779373.635873:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1790779373.635935:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1790779373.635942:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1790779373.638740:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779373.638813:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779373.638866:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7718764540 going to sleep for 11 seconds 00000100:00100000:3.0:1790779373.639048:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663899520 00000100:00100000:3.0:1790779373.639058:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663899520 00000100:00100000:3.0:1790779373.639115:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790779373.639125:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663899520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790779373.639940:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663899520:12345-0@lo:501:mount.lustre.0 Request processed in 814us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779373.639949:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790779373.640178:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790779373.640223:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790779373.640272:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779373.640318:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7718764540 going to sleep for 11 seconds 00000100:00100000:3.0:1790779373.640455:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663899648 00000100:00100000:3.0:1790779373.640462:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663899648 00000100:00100000:3.0:1790779373.640498:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790779373.640505:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663899648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790779373.641756:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663899648:12345-0@lo:503:mount.lustre.0 Request processed in 1247us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779373.641766:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790779373.641966:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899648:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790779373.642633:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790779373.642709:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779373.642761:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779373.642800:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7718764c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790779373.642866:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663899776 00000100:00100000:3.0:1790779373.642873:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663899776 00000100:00100000:3.0:1790779373.642938:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790779373.642947:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663899776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779373.643600:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663899776:12345-0@lo:502:mount.lustre.0 Request processed in 653us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779373.643607:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790779373.643693:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790779373.643918:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1790779373.643950:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1790779373.643966:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1790779373.643981:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1790779373.644009:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1790779373.644040:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1790779373.644056:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1790779373.644082:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1790779373.644097:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1790779373.644124:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790779373.644165:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779373.644198:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7718764c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790779373.644386:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663899904 00000100:00100000:3.0:1790779373.644391:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663899904 00000100:00100000:3.0:1790779373.644431:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790779373.644439:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663899904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779373.644532:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663899904:12345-0@lo:502:mount.lustre.0 Request processed in 93us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779373.644539:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790779373.644659:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663899904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790779373.644700:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1790779373.644708:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1790779373.646064:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790779373.646074:0:25034:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1790779373.646082:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790779373.646085:0:25034:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1790779373.646092:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790779373.646111:0:25034:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b7727430000) 00000020:00000080:0.0:1790779373.646139:0:25034:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790779373.646146:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790779373.646243:0:25034:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b770411d000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1790779373.646253:0:25034:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790779373.646261:0:25034:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb1aa4014e936e7e8 00010000:00010000:1.0:1790779373.651606:0:25034:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1790779373.652566:0:25034:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1790779373.656432:0:25034:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1790779373.658457:0:25034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790779373.658470:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779373.658477:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779373.658479:0:25034:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790779373.658484:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779373.658489:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779373.658490:0:25034:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790779373.658494:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790779373.658496:0:25034:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790779373.658499:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779373.658501:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779373.658503:0:25034:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790779373.658505:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790779373.658507:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779373.658508:0:25034:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790779373.658512:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790779373.658540:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790779373.658543:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790779373.658545:0:25034:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790779373.658548:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1790779373.658829:0:25030:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1790779373.658864:0:25030:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790779373.663493:0:25030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7602671c00/0xb1aa4014e936e7d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7da expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779373.663511:0:25030:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7602671c00/0xb1aa4014e936e7d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7da expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779373.663520:0:25030:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b770411d000 from 1 10000000:01000000:1.0:1790779373.663523:0:25030:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779373.663561:0:25030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779373.663570:0:25030:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779373.663580:0:25030:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779373.663602:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790779373.663664:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.663703:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771190f900 going to sleep for 11 seconds 00000100:00100000:3.0:1790779373.663753:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663900032 00000100:00100000:3.0:1790779373.663761:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663900032 00000100:00100000:3.0:1790779373.663806:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790779373.663814:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+22:25030:x1877767663900032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790779373.663827:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779373.663838:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e7f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e7ef expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.663865:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e7f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e7ef expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.663875:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e7f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e7ef expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.663961:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b770894b400, rc 0) 00000100:00100000:3.0:1790779373.664079:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+23:25030:x1877767663900032:12345-0@lo:101:mount.lustre.0 Request processed in 264us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779373.664086:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790779373.664250:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790779373.664266:0:25030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779373.664275:0:25030:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790779373.667117:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1790779373.667816:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790779373.669600:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1790779373.669649:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1790779373.669662:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1790779373.669674:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1790779373.669685:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1790779373.669697:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1790779373.669713:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1790779373.669728:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1790779373.669742:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1790779373.669757:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1790779373.669794:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1790779373.669823:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1790779373.669829:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1790779373.670841:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790779373.670941:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.671012:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779373.672129:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663900160 00000100:00100000:0.0:1790779373.672141:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663900160 00000100:00100000:0.0:1790779373.672204:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790779373.672212:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+23:25030:x1877767663900160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779373.672494:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+23:25030:x1877767663900160:12345-0@lo:501:mount.lustre.0 Request processed in 282us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779373.672502:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790779373.672554:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779373.672601:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779373.672657:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779373.672681:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779373.672760:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663900288 00000100:00100000:1.0:1790779373.672765:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663900288 00000100:00100000:1.0:1790779373.672796:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790779373.672809:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+23:25030:x1877767663900288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790779373.672918:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+23:25030:x1877767663900288:12345-0@lo:503:mount.lustre.0 Request processed in 109us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779373.672927:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790779373.673965:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790779373.674553:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790779373.674644:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779373.674706:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779373.674751:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779373.675069:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663900416 00000100:00100000:1.0:1790779373.675076:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663900416 00000100:00100000:1.0:1790779373.675117:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790779373.675126:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+23:25030:x1877767663900416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779373.675235:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+23:25030:x1877767663900416:12345-0@lo:502:mount.lustre.0 Request processed in 109us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779373.675243:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790779373.675510:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790779373.675746:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1790779373.675781:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1790779373.675797:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1790779373.675812:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1790779373.675827:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1790779373.675842:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1790779373.675857:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1790779373.675872:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1790779373.675917:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1790779373.675934:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1790779373.675950:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1790779373.675981:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790779373.676042:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779373.676083:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b773438dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779373.676926:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663900544 00000100:00100000:1.0:1790779373.676935:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663900544 00000100:00100000:1.0:1790779373.676977:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790779373.676996:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+23:25030:x1877767663900544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779373.677126:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+23:25030:x1877767663900544:12345-0@lo:502:mount.lustre.0 Request processed in 140us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779373.677134:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790779373.678639:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779373.678731:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1790779373.678744:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1790779373.679779:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779373.679790:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779373.679792:0:25038:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790779373.679806:0:25038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b770411d000 00000020:00000080:3.0:1790779373.679809:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779373.679816:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779373.679818:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779373.679820:0:25038:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790779373.679822:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779373.679824:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779373.679825:0:25038:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790779373.679828:0:25038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b770411d000 00000020:00000080:3.0:1790779373.679830:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779373.681114:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779373.681156:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779373.681158:0:25038:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790779373.681180:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779373.681184:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779373.681185:0:25038:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790779373.681189:0:25038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b770411d000 00000020:00000080:3.0:1790779373.681192:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779373.682281:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779373.683097:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779373.683099:0:25038:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790779373.683106:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790779373.683111:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779373.683112:0:25038:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790779373.683117:0:25038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b770411d000 00000020:00000080:3.0:1790779373.683120:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790779373.683233:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790779373.683238:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790779373.683239:0:25038:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790779373.683243:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1790779373.686999:0:25030:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790779373.687054:0:25030:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779373.687081:0:25030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.687094:0:25030:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779373.687153:0:25030:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790779373.687157:0:25030:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b770411d000 10000000:01000000:0.0:1790779373.687160:0:25030:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b770411d000 10000000:01000000:0.0:1790779373.687173:0:25030:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790779373.687179:0:25030:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b770411d000 from 1 10000000:01000000:0.0:1790779373.687182:0:25030:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790779373.687220:0:25030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76034afa00/0xb1aa4014e936e7fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.687229:0:25030:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b76034afa00/0xb1aa4014e936e7fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.687246:0:25030:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b76034afa00/0xb1aa4014e936e7fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779373.687269:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790779373.687623:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779373.687681:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790779373.687744:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663900672 00000100:00100000:2.0:1790779373.687752:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663900672 00000100:00100000:2.0:1790779373.687806:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790779373.687817:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+23:25030:x1877767663900672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790779373.687841:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779373.687855:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e804 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936e7fd expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.687900:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936e7fd expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.687911:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7602670c00/0xb1aa4014e936e804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e7fd expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.687920:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7602670c00, rc 0) 00000100:00100000:2.0:1790779373.687965:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663900672:12345-0@lo:101:mount.lustre.0 Request processed in 150us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779373.687972:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790779373.688150:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790779373.688165:0:25030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b76034afa00/0xb1aa4014e936e7fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e804 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.688174:0:25030:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b76034afa00/0xb1aa4014e936e7fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936e804 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790779373.689983:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1790779373.690450:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790779373.690721:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1790779373.690752:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1790779373.690768:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1790779373.690783:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1790779373.690798:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1790779373.690812:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1790779373.690827:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1790779373.690842:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1790779373.690858:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1790779373.690872:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1790779373.691893:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1790779373.691918:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1790779373.691931:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1790779373.691944:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1790779373.691966:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1790779373.692010:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1790779373.692037:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1790779373.692051:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1790779373.692062:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1790779373.692074:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1790779373.692087:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1790779373.692101:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1790779373.692115:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1790779373.692132:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1790779373.692146:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1790779373.692158:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1790779373.692184:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1790779373.692198:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1790779373.692213:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1790779373.692228:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1790779373.692243:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1790779373.692278:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1790779373.693472:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1790779373.693512:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1790779373.693528:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1790779373.693542:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1790779373.693555:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1790779373.693580:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1790779373.693596:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1790779373.693611:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1790779373.693628:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1790779373.693643:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1790779373.693658:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1790779373.693675:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1790779373.693689:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1790779373.693704:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1790779373.693719:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1790779373.693765:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1790779373.693984:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1790779373.694010:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1790779373.694042:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1790779373.694048:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1790779373.694157:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779373.697112:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779373.697193:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663900800 00000100:00100000:0.0:1790779373.697206:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663900800 00000100:00100000:0.0:1790779373.697265:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790779373.697275:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663900800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779373.697453:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663900800:12345-0@lo:501:mount.lustre.0 Request processed in 179us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779373.697462:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790779373.697516:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779373.697538:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790779373.697579:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779373.697618:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779373.697647:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663900928 00000100:00100000:0.0:1790779373.697652:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663900928 00000100:00100000:0.0:1790779373.697679:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790779373.697686:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663900928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790779373.697776:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663900928:12345-0@lo:503:mount.lustre.0 Request processed in 89us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779373.697784:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790779373.697922:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790779373.697945:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663900928:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790779373.698481:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790779373.698547:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663901056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779373.698591:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.698612:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711beeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790779373.701377:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663901056 00000100:00100000:1.0:1790779373.701393:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663901056 00000100:00100000:1.0:1790779373.701463:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790779373.701473:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663901056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779373.701650:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663901056:12345-0@lo:502:mount.lustre.0 Request processed in 178us (3057us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779373.701659:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790779373.701733:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663901056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790779373.702258:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1790779373.703429:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1790779373.703460:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1790779373.703478:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1790779373.703494:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1790779373.703509:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1790779373.703524:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1790779373.703536:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1790779373.703550:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1790779373.703565:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1790779373.703581:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1790779373.703617:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1790779373.703632:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1790779373.703645:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1790779373.703655:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1790779373.703666:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1790779373.703678:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1790779373.703691:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1790779373.703705:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1790779373.703719:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1790779373.703733:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1790779373.703748:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1790779373.703762:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1790779373.703776:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1790779373.703807:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1790779373.703821:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1790779373.703835:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1790779373.703866:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1790779373.703907:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1790779373.703926:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1790779373.703941:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1790779373.703956:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1790779373.703970:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1790779373.703985:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1790779373.704402:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1790779373.704421:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1790779373.704438:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1790779373.704454:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1790779373.704471:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1790779373.704486:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1790779373.704501:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1790779373.704516:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1790779373.704531:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1790779373.704563:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1790779373.704580:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1790779373.704594:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1790779373.704609:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1790779373.704624:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1790779373.704687:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663901184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790779373.704768:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.704815:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77182a8240 going to sleep for 11 seconds 00000100:00100000:0.0:1790779373.705854:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663901184 00000100:00100000:0.0:1790779373.705903:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663901184 00000100:00100000:0.0:1790779373.705965:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790779373.705976:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663901184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779373.706154:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663901184:12345-0@lo:502:mount.lustre.0 Request processed in 180us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779373.706171:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790779373.706233:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663901184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779373.706464:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1790779373.706494:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1790779373.706527:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663901312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779373.706567:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779373.706595:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663901312 00000100:00100000:0.0:1790779373.706599:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663901312 00000100:00100000:0.0:1790779373.706622:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790779373.706628:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663901312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790779373.706692:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663901312:12345-0@lo:502:mount.lustre.0 Request processed in 63us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779373.706699:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790779373.706738:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779373.706752:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663901312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790779373.706785:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1790779373.706793:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1790779373.710420:0:25041:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790779373.710438:0:25041:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b7603224d40) 00000020:00000080:1.0:1790779373.710463:0:25041:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1790779373.710563:0:25041:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b770411d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790779373.710575:0:25041:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b770411d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790779373.710578:0:25041:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b770411d000 3 00010000:00080000:1.0:1790779373.710611:0:25041:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b774129d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00010000:1.0:1790779373.718638:0:25041:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1790779373.718825:0:25041:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790779373.718866:0:25041:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790779373.718907:0:25041:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb1aa4014e936e812 00000100:00080000:1.0:1790779373.718917:0:25041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790779373.718928:0:25041:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b774129d800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:1.0:1790779373.718971:0:25041:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b773f4f4380 x1877767663901440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790779373.720110:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663901440:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790779373.720186:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779373.720247:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663901440 00000100:00100000:1.0:1790779373.720254:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663901440 00000100:00100000:1.0:1790779373.720518:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790779373.720526:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1877767663901440:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790779373.720553:0:22712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:1.0:1790779373.720597:0:22712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb1aa4014e936e819 00000004:00100000:1.0:1790779373.720612:0:22712:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790779373.720641:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9b773f475000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790779373.720688:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1877767663901440:12345-0@lo:38:llog_process_th.0 Request processed in 162us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779373.720695:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790779373.720730:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b773f4f4380 x1877767663901440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779373.720739:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790779373.720750:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1790779373.720757:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790779373.720761:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790779373.720763:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b774129d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790779373.720767:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1877767663901440:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1790779373.720784:0:25041:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790779373.720849:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779373.720854:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790779373.720856:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790779373.720864:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:2.0:1790779373.723392:0:25041:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790779373.723410:0:25041:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9b7726b6b380) 00000020:00000080:2.0:1790779373.723440:0:25041:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1790779373.723521:0:25041:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b770411d000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790779373.723525:0:25041:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b770411d000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790779373.723527:0:25041:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b770411d000 3 00010000:00080000:2.0:1790779373.723558:0:25041:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b7604540800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.103@tcp at head 00010000:00010000:2.0:1790779373.732336:0:25041:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1790779373.734277:0:25041:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1790779373.734325:0:25041:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790779373.734338:0:25041:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb1aa4014e936e827 00000100:00080000:2.0:1790779373.734350:0:25041:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790779373.734361:0:25041:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b7604540800 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779373.734395:0:25041:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7735c14380 x1877767663901568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779373.734445:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1877767663901568:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790779373.734513:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779373.734572:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663901568 00000100:00100000:2.0:1790779373.734578:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663901568 00000100:00100000:2.0:1790779373.734613:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790779373.734622:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1877767663901568:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790779373.734647:0:22713:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:2.0:1790779373.734685:0:22713:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb1aa4014e936e82e 00000004:00100000:2.0:1790779373.735307:0:22713:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790779373.735347:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9b774129b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779373.735626:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1877767663901568:12345-0@lo:38:llog_process_th.0 Request processed in 1002us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779373.735634:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790779373.735977:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b7735c14380 x1877767663901568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790779383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779373.735988:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790779373.735996:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1790779373.736003:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790779373.736007:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790779373.736009:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7604540800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790779373.736016:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1877767663901568:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1790779373.736333:0:25041:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790779373.736697:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779373.736703:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790779373.736712:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790779373.736715:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1790779373.737134:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1790779373.737219:0:25030:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790779373.737253:0:25030:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790779373.737273:0:25030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b76034afa00/0xb1aa4014e936e7fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e804 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.737346:0:25030:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b76034afa00/0xb1aa4014e936e7fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936e804 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790779373.737393:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790779373.737396:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790779373.737398:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779373.737399:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779373.737400:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779373.737405:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779373.737406:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779373.737408:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779373.737409:0:25030:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790779373.737414:0:25030:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1790779373.737416:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790779373.737417:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790779373.737418:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790779373.737420:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790779373.737421:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790779373.737421:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790779373.737422:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790779373.737423:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790779373.737424:0:25030:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790779373.737445:0:25030:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790779373.737461:0:25030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663901696:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790779373.737517:0:25030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779373.737554:0:25030:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7711aa1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790779373.737743:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663901696 00000100:00100000:0.0:1790779373.737750:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663901696 00000100:00100000:0.0:1790779373.737821:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790779373.737830:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663901696:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790779373.737854:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790779373.737868:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790779373.749479:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790779373.749505:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790779373.749799:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+24:25030:x1877767663901696:12345-0@lo:253:mount.lustre.0 Request processed in 11965us (12275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779373.749812:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 20000000:01000000:2.0:1790779373.749905:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790779373.749910:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790779373.749930:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.749946:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e7a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e7a2 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.749954:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e7b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e7b0 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.749962:0:22727:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.750098:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e7b0 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.750130:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e7b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e7b0 expref: 23 pid: 22705 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779373.750144:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663901824:0@lo:104: 00000100:00100000:2.0:1790779373.750180:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779373.750269:0:25030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e9d73c52-009d-4820-b396-7792bc096088:25030:1877767663901696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790779373.750286:0:25030:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790779373.750289:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790779373.750291:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790779373.750292:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790779373.750293:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790779373.750294:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790779373.750295:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790779373.750296:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790779373.750298:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790779373.750299:0:25030:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790779373.750311:0:25030:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1790779373.750402:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e7a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e7a2 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779373.750411:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e7a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e7a2 expref: 23 pid: 22705 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779373.750422:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663901952:0@lo:104: 00000100:00100000:2.0:1790779373.750451:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779373.755156:0:22727:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76027c8300 going to sleep for 11 seconds 00000100:00100000:0.0:1790779373.755203:0:22695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663901824 00000100:00100000:0.0:1790779373.755212:0:22695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663901824 00000100:00100000:0.0:1790779373.755250:0:22695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663901952 00000100:00100000:0.0:1790779373.755253:0:22695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663901952 00000100:00100000:0.0:1790779373.755272:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779373.755281:0:22695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+4:22727:x1877767663901824:12345-0@lo:104: 00010000:00010000:0.0:1790779373.755587:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.755683:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790779373.755689:0:22695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+4:22727:x1877767663901824:12345-0@lo:104: Request processed in 410us (5509us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779373.755697:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779373.755718:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790779373.755724:0:22695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+3:22727:x1877767663901952:12345-0@lo:104: 00010000:00010000:0.0:1790779373.755732:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.755777:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790779373.755783:0:22695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e9d73c52-009d-4820-b396-7792bc096088+3:22727:x1877767663901952:12345-0@lo:104: Request processed in 59us (5333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779373.755788:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1790779373.755803:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790779373.755810:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.755818:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034af800 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:0.0:1790779373.755822:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.755831:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790779373.755838:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779373.755843:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1790779373.756179:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663901824:0@lo:104: 00000100:00100000:1.0:1790779373.756191:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1877767663901952:0@lo:104: 00010000:00010000:1.0:1790779373.756211:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.756523:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.756530:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790779373.756558:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1790779373.756585:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9d73c52-009d-4820-b396-7792bc096088:3652:1877767663902080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779373.756632:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790779373.756687:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779373.756690:0:22696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663902080 00000001:00000004:2.0:1790779373.756692:0:25030:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1790779373.756696:0:22696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663902080 00010000:00010000:0.0:1790779373.756702:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76034af800/0xb1aa4014e936e7b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e7b7 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.756719:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e7b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e7b0 expref: 24 pid: 22705 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779373.756726:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779373.756729:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779373.756732:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779373.756745:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790779373.756754:0:22696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+24:3652:x1877767663902080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779373.756778:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779373.756785:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e7b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e7b0 expref: 24 pid: 22705 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.756797:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e7b0 expref: 24 pid: 22705 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.756810:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7602671200/0xb1aa4014e936e7b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e7b0 expref: 24 pid: 22705 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.756829:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779373.759187:0:22696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+23:3652:x1877767663902080:12345-0@lo:103:ldlm_bl.0 Request processed in 2428us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779373.759198:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00002000:00080000:2.0:1790779373.761594:0:25030:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790779373.761603:0:25030:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790779373.761639:0:25030:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790779373.761688:0:25030:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790779373.761719:0:25030:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1790779373.761756:0:25030:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1790779373.762690:0:25030:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779373.762954:0:25030:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790779373.765581:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9d73c52-009d-4820-b396-7792bc096088:3652:1877767663902080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779373.784490:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779373.784495:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779373.784498:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779373.784598:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779373.784620:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602670400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:1.0:1790779373.784624:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779373.784633:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790779373.784640:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779373.784645:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790779373.784688:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779373.784694:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790779373.784718:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779373.784724:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7602670400/0xb1aa4014e936e7a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e7a9 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779373.784740:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779373.784742:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779373.784743:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779373.784749:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790779373.784765:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663902208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790779373.784819:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779373.785061:0:22698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663902208 00000100:00100000:3.0:1790779373.785068:0:22698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663902208 00010000:00010000:3.0:1790779373.785094:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e7a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e7a2 expref: 23 pid: 22705 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779373.785149:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790779373.785156:0:22698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9d73c52-009d-4820-b396-7792bc096088+23:3650:x1877767663902208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779373.785167:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779373.785172:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e7a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e7a2 expref: 23 pid: 22705 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.785182:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e7a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e7a2 expref: 23 pid: 22705 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.785193:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894a000/0xb1aa4014e936e7a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e7a2 expref: 23 pid: 22705 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.785207:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.785214:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790779373.785227:0:22698:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.035317315s 00010000:00010000:3.0:1790779373.785230:0:22698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.785243:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.785249:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.785255:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.785260:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602670a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779373.785263:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.785270:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.785291:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779373.785301:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779373.785345:0:22698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9d73c52-009d-4820-b396-7792bc096088+22:3650:x1877767663902208:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779373.785351:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1790779373.785395:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779373.785412:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779373.785418:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7602670a00/0xb1aa4014e936e835 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779373.785542:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663902208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790779373.929062:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779374.184855:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663902336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779374.184961:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779374.185133:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663902336 00000100:00100000:1.0:1790779374.185141:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663902336 00000100:00100000:1.0:1790779374.185193:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790779374.185202:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663902336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779374.185236:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790779374.185292:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663902336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779374.185300:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790779374.185693:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663902336:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1790779374.644584:0:25099:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790779374.644777:0:25099:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790779374.696235:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663902464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779374.696304:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779374.696467:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663902464 00000100:00100000:1.0:1790779374.696476:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663902464 00000100:00100000:1.0:1790779374.696527:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790779374.696536:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663902464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790779374.696570:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790779374.696616:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663902464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779374.696623:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790779374.697531:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663902464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790779374.759966:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779354/real 1790779354] req@ffff9b7603744000 x1877767663889408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779374.760005:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603744000 x1877767663889408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779374.760032:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790779354/real 1790779354] req@ffff9b7603747480 x1877767663889536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779374.760046:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b7603747480 x1877767663889536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790779374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790779374.760063:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7711c96000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779374.760085:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790779374.760089:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663889408:0@lo:8:kworker.0 00000100:00080000:1.0:1790779374.760096:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7741db3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790779374.760101:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790779374.760104:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663889536:0@lo:8:kworker.0 00000100:00080000:2.0:1790779374.760474:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779374.760479:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790779374.760482:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7711c96000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779374.760487:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 672 00000100:00080000:2.0:1790779374.760493:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790779374.760503:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b7711c96000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779374.760527:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b7735c15880 x1877767663902720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779374.760541:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779374.760545:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790779374.760546:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b7741db3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779374.760549:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 672 00000100:00080000:2.0:1790779374.760552:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790779374.760556:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b7741db3000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779374.760571:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b76046cc380 x1877767663902848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790779374.760603:0:9333:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790779374.760606:0:9333:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790779374.760608:0:9333:0:(import.c:65:import_set_state_nolock()) ffff9b772012b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790779374.760611:0:9333:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 691 00000100:00080000:2.0:1790779374.760614:0:9333:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1790779374.760618:0:9333:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b772012b000 using connection 192.168.203.103@tcp/0@lo 00000100:00100000:2.0:1790779374.760644:0:9333:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b76046cce00 x1877767663903232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790779374.760710:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663903360:0@lo:400:kworker.0 00000100:00100000:2.0:1790779374.760765:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779374.760796:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663903872:0@lo:400:kworker.0 00000100:00100000:2.0:1790779374.760819:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779374.760839:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790779374.760845:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663902592:0@lo:400:kworker.0 00000100:00100000:2.0:1790779374.760873:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779374.760919:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663903488:0@lo:400:kworker.0 00000100:00100000:2.0:1790779374.761117:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779374.761418:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663902976:0@lo:400:kworker.0 00000100:00100000:2.0:1790779374.761443:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779374.761503:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663902592 00000100:00100000:1.0:1790779374.761510:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663902592 00000100:00100000:1.0:1790779374.761559:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790779374.761566:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+22:3651:x1877767663902592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779374.761611:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+22:3651:x1877767663902592:12345-0@lo:400:kworker.0 Request processed in 45us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779374.761617:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790779374.761664:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663902592:0@lo:400:kworker.0 00000100:00100000:0.0:1790779374.761818:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663903360 00000100:00100000:0.0:1790779374.761823:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663903360 00000100:00100000:2.0:1790779374.761831:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663903616:0@lo:400:kworker.0 00000100:00100000:2.0:1790779374.761855:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779374.761868:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790779374.761874:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663903104:0@lo:400:kworker.0 00000100:00100000:0.0:1790779374.761941:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663903872 00000100:00100000:0.0:1790779374.761945:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663903872 00000100:00100000:0.0:1790779374.762047:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663903488 00000100:00100000:0.0:1790779374.762051:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663903488 00000100:00100000:0.0:1790779374.762062:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663902976 00000100:00080000:1.0:1790779374.762065:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790779374.762065:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663902976 00000100:00100000:0.0:1790779374.762074:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663903616 00000100:00100000:0.0:1790779374.762077:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663903616 00000100:00100000:0.0:1790779374.762089:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790779374.762095:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663903360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779374.762145:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663903360:12345-0@lo:400:kworker.0 Request processed in 50us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779374.762152:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790779374.762165:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790779374.762171:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663903872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779374.762201:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663903872:12345-0@lo:400:kworker.0 Request processed in 30us (1380us total) trans 0 rc 0/0 00010000:00080000:1.0:1790779374.762217:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cd880 x1877767663903360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779374.762233:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663903360:0@lo:400:kworker.0 00010000:00080000:1.0:1790779374.762242:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cca80 x1877767663903872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779374.762261:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663903872:0@lo:400:kworker.0 00000100:00100000:3.0:1790779374.762294:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790779374.762303:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790779374.762307:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663903488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779374.762315:0:22713:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790779374.762321:0:22713:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1790779374.762355:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1877767663903488:12345-0@lo:400:kworker.0 Request processed in 50us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779374.762361:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790779374.762594:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790779374.762604:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663902976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779374.762637:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663902976:12345-0@lo:400:kworker.0 Request processed in 35us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779374.762823:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779374.762842:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663903744:0@lo:400:kworker.0 00000100:00100000:2.0:1790779374.762865:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790779374.762897:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cfb80 x1877767663902976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779374.762907:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663902976:0@lo:400:kworker.0 00000100:00100000:2.0:1790779374.762941:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663903744 00000100:00100000:2.0:1790779374.762945:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663903744 00000100:00100000:1.0:1790779374.763157:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790779374.763166:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663903616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779374.763202:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663903616:12345-0@lo:400:kworker.0 Request processed in 38us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779374.763208:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790779374.763256:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790779374.763280:0:24218:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663903104 00000100:00100000:3.0:1790779374.763283:0:24218:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663903104 00000100:00100000:2.0:1790779374.763342:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790779374.763346:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790779374.763350:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663903744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779374.763352:0:24218:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663903104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779374.763476:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1877767663903744:12345-0@lo:400:kworker.0 Request processed in 127us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779374.763478:0:24218:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663903104:12345-0@lo:400:kworker.0 Request processed in 127us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779374.763483:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790779374.763484:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790779374.763504:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663902720:0@lo:8:kworker.0 00000100:00100000:3.0:1790779374.763530:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779374.763593:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663902848:0@lo:8:kworker.0 00000100:00100000:3.0:1790779374.763614:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779374.763667:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663903232:0@lo:8:kworker.0 00000100:00100000:3.0:1790779374.763692:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779374.763710:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663902720 00000100:00100000:1.0:1790779374.763714:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663902720 00000100:00100000:1.0:1790779374.763735:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663902848 00000100:00100000:1.0:1790779374.763738:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663902848 00000100:00100000:1.0:1790779374.763751:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790779374.763755:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3648:x1877767663902720:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790779374.763781:0:24697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:1.0:1790779374.763807:0:24697:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936e83c 00002000:00100000:1.0:1790779374.763821:0:24697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b773f474800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1790779374.763826:0:24697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1790779374.763829:0:24697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790779374.763926:0:24697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1790779374.763948:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1790779374.763961:0:24697:0:(import.c:65:import_set_state_nolock()) ffff9b773f476800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779374.764109:0:24217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1877767663902848:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1790779374.764125:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1877767663902720:12345-0@lo:8:kworker.0 Request processed in 368us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779374.764132:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790779374.764134:0:24217:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:0.0:1790779374.764155:0:24217:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1aa4014e936e843 00002000:00100000:0.0:1790779374.764162:0:24217:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b76038f0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790779374.764165:0:24217:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1790779374.764167:0:24217:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1790779374.764255:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c15880 x1877767663902720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790779399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779374.764265:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790779374.764278:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1790779374.764285:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790779374.764290:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790779374.764293:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7711c96000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790779374.764308:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00002000:00080000:0.0:1790779374.764310:0:24217:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1790779374.764313:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663902720:0@lo:8:kworker.0 00000100:00080000:0.0:1790779374.764323:0:24217:0:(import.c:65:import_set_state_nolock()) ffff9b76038f2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790779374.764350:0:24218:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663903232 00000100:00100000:1.0:1790779374.764355:0:24218:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663903232 00000100:00100000:0.0:1790779374.764366:0:24217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1877767663902848:12345-0@lo:8:kworker.0 Request processed in 259us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779374.764370:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790779374.764374:0:24218:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1877767663903232:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790779374.764386:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790779374.764461:0:24218:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:1.0:1790779374.764477:0:24218:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb1aa4014e936e84a 00002000:00100000:1.0:1790779374.764483:0:24218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9b773f472000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1790779374.764486:0:24218:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1790779374.764488:0:24218:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790779374.764512:0:24218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1790779374.764524:0:24218:0:(import.c:65:import_set_state_nolock()) ffff9b773f476000 : changing import state from RECOVER to FULL 00000004:00080000:2.0:1790779374.764548:0:22735:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1790779374.764550:0:24218:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1877767663903232:12345-0@lo:8:kworker.0 Request processed in 174us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779374.764557:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:2.0:1790779374.764602:0:22735:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692771721686ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790779374.764608:0:22735:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:2.0:1790779374.764628:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779374.764650:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663904000:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1790779374.764653:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cdc00 x1877767663903104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790779390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779374.764662:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663903104:0@lo:400:kworker.0 00010000:00080000:2.0:1790779374.764673:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cea00 x1877767663903744/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779374.764680:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3649:1877767663903744:0@lo:400:kworker.0 00000100:00100000:1.0:1790779374.764682:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790779374.764704:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cc000 x1877767663903616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779374.764712:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663903616:0@lo:400:kworker.0 00000004:00080000:3.0:1790779374.764717:0:22736:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:3.0:1790779374.764736:0:22736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1877767663904128:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790779374.764758:0:22736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779374.764775:0:22736:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030c0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790779374.764786:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663904128 00000100:00100000:3.0:1790779374.764789:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663904128 00000100:00100000:3.0:1790779374.764819:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779374.764824:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22736:x1877767663904128:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1790779374.765041:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790779374.765067:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cf800 x1877767663903488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779374.765077:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1877767663903488:0@lo:400:kworker.0 00010000:00080000:3.0:1790779374.765101:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cc380 x1877767663902848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790779399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779374.765107:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790779374.765112:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1790779374.765116:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790779374.765120:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790779374.765122:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b7741db3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790779374.765134:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790779374.765144:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1877767663902848:0@lo:8:kworker.0 00010000:00080000:3.0:1790779374.765157:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cce00 x1877767663903232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790779399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779374.765164:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790779374.765168:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1790779374.765172:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790779374.765175:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790779374.765177:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9b772012b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790779374.765189:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790779374.765192:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1877767663903232:0@lo:8:kworker.0 00000004:00080000:3.0:1790779374.765230:0:22738:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1790779374.765242:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1877767663904384:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790779374.765266:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779374.765284:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030c0000 going to sleep for 11 seconds 00000004:00080000:3.0:1790779374.765295:0:22737:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790779374.765334:0:22737:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692772453375ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790779374.765338:0:22737:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1790779374.765361:0:23455:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1790779374.765374:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23455:1877767663904640:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1790779374.765407:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779374.765423:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030c0240 going to sleep for 11 seconds 00000100:00100000:3.0:1790779374.765435:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663904256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779374.765456:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779374.765477:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779374.765483:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663904512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779374.765504:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779374.765539:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663904000 00000100:00100000:3.0:1790779374.765543:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663904000 00000100:00100000:3.0:1790779374.765559:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663904256 00000100:00100000:3.0:1790779374.765562:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663904256 00000100:00100000:3.0:1790779374.765579:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663904512 00000100:00100000:3.0:1790779374.765582:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663904512 00000100:00100000:3.0:1790779374.765595:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790779374.765601:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1877767663904000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790779374.765614:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790779374.766180:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1877767663904000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 578us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779374.766188:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790779374.766207:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790779374.766214:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663904256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790779374.766225:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779374.766261:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663904256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779374.766268:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790779374.766280:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790779374.766286:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1877767663904512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779374.766295:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1790779374.766318:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1877767663904512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779374.766323:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790779374.766338:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790779374.766356:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b768e00 x1877767663904512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779374.766392:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663904512:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1790779374.766405:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b768700 x1877767663904256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779374.766416:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663904256:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1790779374.767407:0:24695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1790779374.767416:0:24695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1790779374.767420:0:24695:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:0.0:1790779374.768822:0:23454:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790779374.769066:0:23454:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 692776185989ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790779374.769076:0:23454:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:1.0:1790779374.770180:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b76a680 x1877767663904000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790779390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790779374.770203:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663904000:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1790779374.771608:0:22691:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1790779374.771627:0:22691:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1790779374.771658:0:24218:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663904384 00000100:00100000:1.0:1790779374.771667:0:24218:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663904384 00000100:00100000:1.0:1790779374.771707:0:24218:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663904640 00000100:00100000:1.0:1790779374.771710:0:24218:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663904640 00000100:00100000:1.0:1790779374.771820:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790779374.771831:0:24218:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22738:x1877767663904384:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790779374.773776:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790779374.773818:0:24217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23455:x1877767663904640:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1790779374.778245:0:23444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:2.0:1790779374.780217:0:24218:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1790779374.780226:0:24218:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1790779374.780232:0:24218:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00002000:00080000:2.0:1790779374.782963:0:24217:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1790779374.782971:0:24217:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1790779374.783076:0:24217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23455:x1877767663904640:12345-0@lo:7:osp-pre-1-1.0 Request processed in 9285us (17664us total) trans 0 rc 0/0 00002000:00010000:0.0:1790779374.783086:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1790779374.783087:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1790779374.783095:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e851 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.783112:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.783116:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.783123:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e851 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.783142:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e851 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1790779374.783158:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773b768000 x1877767663904640/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790779390 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1790779374.783162:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e851 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.783170:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e851 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779374.783172:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23455:1877767663904640:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1790779374.783187:0:23455:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00010000:00010000:0.0:1790779374.783187:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790779374.783225:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23455:1877767663904768:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790779374.783258:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779374.783279:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030c0240 going to sleep for 11 seconds 00010000:00010000:2.0:1790779374.783293:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.783299:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e851 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.783306:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034aec00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.783310:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e851 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.783320:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e851 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.783337:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e851 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.783344:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e851 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.783362:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.783364:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.783371:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779374.783385:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663904768 00000100:00100000:2.0:1790779374.783390:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663904768 00000100:00100000:2.0:1790779374.783436:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790779374.783444:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23455:x1877767663904768:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1790779374.783468:0:24697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1790779374.783497:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23455:x1877767663904768:12345-0@lo:5:osp-pre-1-1.0 Request processed in 55us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779374.783503:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790779374.783526:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23455:1877767663904768:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1790779374.783533:0:23455:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1790779374.783552:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23455:1877767663904896:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790779374.783570:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779374.783581:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b76030c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1790779374.783591:0:24217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663904896 00000100:00100000:2.0:1790779374.783593:0:24217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663904896 00000100:00100000:2.0:1790779374.783609:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790779374.783614:0:24217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23455:x1877767663904896:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1790779374.783633:0:24217:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1790779374.787591:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.787603:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e858 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.787620:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.787625:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.787631:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e858 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.787645:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e858 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.787656:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e858 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.787665:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e858 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.787709:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779374.787924:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.787931:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e858 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.787940:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.787944:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e858 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.787966:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e858 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.787984:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e858 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.787991:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e858 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.788018:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.788020:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.788022:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779374.790653:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.790666:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e85f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.790683:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.790688:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.790694:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.790708:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.790718:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.790726:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e85f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.790745:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790779374.790861:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779374.790868:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e85f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.790876:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034af800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779374.790907:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e85f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.790917:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e85f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.790933:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e85f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.790941:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e85f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.790958:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.790960:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.790962:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779374.793204:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.793215:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e866 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.793232:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.793237:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.793244:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e866 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.793269:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e866 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.793280:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e866 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.793294:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e866 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.793311:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779374.794541:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.794552:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e866 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.794564:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034aee00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.794568:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e866 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.794577:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e866 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.794594:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e866 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.794614:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e866 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.794634:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.794636:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.794637:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779374.797226:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.797238:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e86d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.798076:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.798083:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.798091:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e86d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.798108:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e86d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.798120:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e86d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.798128:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e86d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.798159:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779374.801555:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.801570:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e86d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.801585:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034af600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.801591:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e86d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.801603:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e86d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.801624:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e86d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.801633:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e86d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.801657:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.801659:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.801661:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779374.807207:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.807220:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b943b084/0xb1aa4014e936e874 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.807242:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.807247:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.807253:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b943b084/0xb1aa4014e936e874 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779374.809116:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.809131:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936e87b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.809145:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b943b084/0xb1aa4014e936e874 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.809148:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.809157:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.809162:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b943b084/0xb1aa4014e936e874 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.809165:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936e87b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.809180:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b943b084/0xb1aa4014e936e874 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.809189:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936e87b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.809198:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936e87b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.809200:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779374.809209:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936e87b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.809239:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790779374.809564:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779374.809565:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779374.809576:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936e87b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.809577:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b943b084/0xb1aa4014e936e874 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.809599:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779374.809604:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936e87b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.809610:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034afe00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779374.809618:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936e87b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.809619:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b943b084/0xb1aa4014e936e874 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.809642:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b943b084/0xb1aa4014e936e874 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.809643:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936e87b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.809660:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ffbc26d/0xb1aa4014e936e87b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.809683:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.809685:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b943b084/0xb1aa4014e936e874 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.809686:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.809689:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.809698:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b943b084/0xb1aa4014e936e874 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.809723:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.809725:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.809728:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779374.810231:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.810238:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e882 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810249:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.810260:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.810265:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e882 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810275:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e882 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810283:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e882 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810290:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e882 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810309:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790779374.810613:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.810620:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e889 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810629:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.810632:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.810637:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e889 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810646:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e889 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810654:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e889 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810666:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e889 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810684:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790779374.810694:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779374.810699:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e882 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810706:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779374.810710:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e882 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810719:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e882 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810731:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e882 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810738:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e882 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810751:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779374.810754:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e889 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810772:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779374.810775:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e889 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810782:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e889 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810793:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e889 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810800:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e889 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.810811:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.810812:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.810814:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.811438:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779374.811657:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.811667:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca1c9af4/0xb1aa4014e936e890 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.811681:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.811686:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.811691:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca1c9af4/0xb1aa4014e936e890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.811704:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca1c9af4/0xb1aa4014e936e890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.811714:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca1c9af4/0xb1aa4014e936e890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.811722:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca1c9af4/0xb1aa4014e936e890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.811754:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790779374.811765:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779374.811771:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca1c9af4/0xb1aa4014e936e890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.811779:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779374.811783:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca1c9af4/0xb1aa4014e936e890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.811793:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca1c9af4/0xb1aa4014e936e890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.811808:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca1c9af4/0xb1aa4014e936e890 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.811817:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca1c9af4/0xb1aa4014e936e890 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.811834:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.811837:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.811840:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779374.812137:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.812143:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b3fcf0b/0xb1aa4014e936e897 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.812165:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.812174:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.812179:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b3fcf0b/0xb1aa4014e936e897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.812190:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b3fcf0b/0xb1aa4014e936e897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.812199:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b3fcf0b/0xb1aa4014e936e897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.812207:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b3fcf0b/0xb1aa4014e936e897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.812222:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779374.813254:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779374.813263:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b3fcf0b/0xb1aa4014e936e897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813275:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034af000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779374.813279:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b3fcf0b/0xb1aa4014e936e897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813288:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b3fcf0b/0xb1aa4014e936e897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813311:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b3fcf0b/0xb1aa4014e936e897 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813318:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b3fcf0b/0xb1aa4014e936e897 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813335:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.813337:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.813340:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779374.813406:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.813412:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e89e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813422:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.813426:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.813431:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e89e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813442:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e89e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813450:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e89e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813457:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e89e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813489:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790779374.813500:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779374.813505:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e89e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813512:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779374.813515:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e89e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813523:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e89e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813534:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e89e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813541:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1dbb22e/0xb1aa4014e936e89e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.813555:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.813557:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.813559:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779374.814032:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.814039:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c9c7c8f/0xb1aa4014e936e8a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814049:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.814060:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.814065:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c9c7c8f/0xb1aa4014e936e8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814076:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c9c7c8f/0xb1aa4014e936e8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814084:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c9c7c8f/0xb1aa4014e936e8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814093:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c9c7c8f/0xb1aa4014e936e8a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814122:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779374.814183:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.814191:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c9c7c8f/0xb1aa4014e936e8a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.814200:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.814205:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c9c7c8f/0xb1aa4014e936e8a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.814213:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c9c7c8f/0xb1aa4014e936e8a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.814229:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c9c7c8f/0xb1aa4014e936e8a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.814237:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c9c7c8f/0xb1aa4014e936e8a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.814256:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.814258:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.814261:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779374.814449:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.814456:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b66a48/0xb1aa4014e936e8ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814464:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.814468:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.814473:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014b66a48/0xb1aa4014e936e8ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814483:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014b66a48/0xb1aa4014e936e8ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814490:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b66a48/0xb1aa4014e936e8ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814505:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014b66a48/0xb1aa4014e936e8ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814529:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790779374.814867:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.814874:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceca24c5/0xb1aa4014e936e8b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814904:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.814908:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.814913:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceca24c5/0xb1aa4014e936e8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814923:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ceca24c5/0xb1aa4014e936e8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814932:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceca24c5/0xb1aa4014e936e8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814939:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ceca24c5/0xb1aa4014e936e8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.814954:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790779374.814962:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790779374.814966:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014b66a48/0xb1aa4014e936e8ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815045:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779374.815050:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b66a48/0xb1aa4014e936e8ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815059:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b66a48/0xb1aa4014e936e8ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815069:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014b66a48/0xb1aa4014e936e8ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815076:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014b66a48/0xb1aa4014e936e8ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815091:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790779374.815094:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ceca24c5/0xb1aa4014e936e8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815101:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:3.0:1790779374.815104:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceca24c5/0xb1aa4014e936e8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815112:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceca24c5/0xb1aa4014e936e8b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815122:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ceca24c5/0xb1aa4014e936e8b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815136:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ceca24c5/0xb1aa4014e936e8b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815149:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.815151:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.815153:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.815467:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779374.815470:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.815476:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152496a9/0xb1aa4014e936e8ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815486:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.815490:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.815495:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000152496a9/0xb1aa4014e936e8ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815504:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000152496a9/0xb1aa4014e936e8ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815512:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000152496a9/0xb1aa4014e936e8ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815520:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000152496a9/0xb1aa4014e936e8ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.815540:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779374.815827:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.815834:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000152496a9/0xb1aa4014e936e8ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.815842:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.815845:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000152496a9/0xb1aa4014e936e8ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.815863:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000152496a9/0xb1aa4014e936e8ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.816075:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000152496a9/0xb1aa4014e936e8ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.816085:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000152496a9/0xb1aa4014e936e8ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.816099:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.816101:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.816104:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779374.816129:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.816142:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936e8c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.816151:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.816154:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.816159:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936e8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.816169:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936e8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.816178:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936e8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.816186:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936e8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779374.816443:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.816450:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e8c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.816460:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.816463:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.816467:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e8c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.816478:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e8c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.816486:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e8c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.816501:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e8c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.816528:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790779374.816917:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779374.816924:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936e8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.816932:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.816936:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936e8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.816944:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936e8c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.816959:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936e8c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779374.817131:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.817136:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a7cda0/0xb1aa4014e936e8cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.817146:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.817149:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.817153:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056a7cda0/0xb1aa4014e936e8cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.817162:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056a7cda0/0xb1aa4014e936e8cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.817182:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056a7cda0/0xb1aa4014e936e8cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.817189:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056a7cda0/0xb1aa4014e936e8cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.817201:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790779374.817532:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.817538:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936e8d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.817546:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.817549:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.817553:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936e8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.817562:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936e8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.817567:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790779374.817570:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936e8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.817576:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936e8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.817596:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1790779374.817859:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.817865:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e8dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.817873:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.817876:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.818034:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e8dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818044:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e8dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818052:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e8dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818060:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e8dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818068:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1790779374.818102:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.818108:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e8e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.818116:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.818119:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.818123:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e8e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.818133:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e8e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.818141:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e8e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.818148:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e8e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.818156:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1790779374.818322:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.818328:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008db18ad/0xb1aa4014e936e8eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818336:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.818344:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.818349:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008db18ad/0xb1aa4014e936e8eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818358:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008db18ad/0xb1aa4014e936e8eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818366:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008db18ad/0xb1aa4014e936e8eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818373:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008db18ad/0xb1aa4014e936e8eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818467:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1790779374.818560:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.818566:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e8f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.818581:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.818584:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.818588:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e8f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.818613:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e8f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.818622:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e8f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.818629:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e8f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.818639:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1790779374.818738:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.818744:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936e8f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818753:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.818755:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.818759:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936e8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818768:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936e8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818776:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936e8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818791:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936e8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.818799:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1790779374.819130:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.819136:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e900 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.819145:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.819148:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.819152:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e900 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.819176:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e900 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.819195:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e900 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819202:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056bd3565/0xb1aa4014e936e8c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.819202:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e900 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.819212:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:2.0:1790779374.819227:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1790779374.819232:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e8c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819239:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034af600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.819243:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e8c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819252:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e8c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819266:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e8c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819274:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a288d4c/0xb1aa4014e936e8c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819287:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1790779374.819291:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056a7cda0/0xb1aa4014e936e8cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819297:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2e00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.819306:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a7cda0/0xb1aa4014e936e8cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819314:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056a7cda0/0xb1aa4014e936e8cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819324:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056a7cda0/0xb1aa4014e936e8cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819332:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056a7cda0/0xb1aa4014e936e8cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819344:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1790779374.819348:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936e8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819353:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.819356:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936e8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819363:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936e8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819372:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936e8d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779374.819619:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1790779374.819621:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.819625:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936e907 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.819626:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e90e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.819635:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.819635:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.819639:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.819639:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.819644:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936e907 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.819644:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.819654:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936e907 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.819654:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.819663:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936e907 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.819663:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.819672:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936e907 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.819672:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e90e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.819680:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1790779374.819766:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1790779374.819938:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feef0ca3/0xb1aa4014e936e8d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819960:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1790779374.819964:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e8dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.819970:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.819973:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e8dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779374.820034:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.820039:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adc1c5b9/0xb1aa4014e936e915 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.820048:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.820049:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e8dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.820051:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.820055:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adc1c5b9/0xb1aa4014e936e915 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820061:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e8dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.820064:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adc1c5b9/0xb1aa4014e936e915 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820068:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dc9a9c1/0xb1aa4014e936e8dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.820072:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adc1c5b9/0xb1aa4014e936e915 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.820079:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adc1c5b9/0xb1aa4014e936e915 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820082:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1790779374.820085:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e8e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.820087:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1790779374.820091:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034af800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.820094:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e8e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820114:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e8e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820125:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e8e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820132:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005934c7b9/0xb1aa4014e936e8e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820147:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1790779374.820150:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008db18ad/0xb1aa4014e936e8eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820157:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.820160:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008db18ad/0xb1aa4014e936e8eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820168:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008db18ad/0xb1aa4014e936e8eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820178:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008db18ad/0xb1aa4014e936e8eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820184:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008db18ad/0xb1aa4014e936e8eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820214:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790779374.820219:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e8f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820225:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034aee00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.820228:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e8f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820236:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e8f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820246:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e8f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820253:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da81ea49/0xb1aa4014e936e8f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820265:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790779374.820268:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936e8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820274:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.820277:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936e8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820295:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936e8f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820306:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936e8f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820313:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000711ea329/0xb1aa4014e936e8f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820326:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790779374.820330:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e900 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820337:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034ae000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.820340:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e900 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820347:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e900 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820356:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e900 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.820363:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8fd07a6/0xb1aa4014e936e900 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779374.820513:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.820519:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936e91c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.820533:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.820536:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.820540:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936e91c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.820548:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936e91c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.820555:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936e91c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.820563:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936e91c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.820571:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1790779374.820908:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.820914:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936e923 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.820922:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.820925:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.820929:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936e923 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.820938:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936e923 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.820957:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936e923 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.820964:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936e923 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.820972:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1790779374.821075:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790779374.821079:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936e907 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821086:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.821090:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936e907 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821098:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936e907 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821109:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936e907 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821116:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c0d08b/0xb1aa4014e936e907 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821126:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790779374.821130:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e90e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821136:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034aec00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.821140:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e90e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821157:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e90e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821166:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e90e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821173:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005299fd43/0xb1aa4014e936e90e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821183:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790779374.821186:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adc1c5b9/0xb1aa4014e936e915 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821192:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768e00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.821195:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adc1c5b9/0xb1aa4014e936e915 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821203:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adc1c5b9/0xb1aa4014e936e915 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821211:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adc1c5b9/0xb1aa4014e936e915 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821217:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adc1c5b9/0xb1aa4014e936e915 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821235:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779374.821238:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936e91c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821244:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3e00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.821247:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936e91c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821255:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936e91c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821263:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936e91c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821269:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003913dc38/0xb1aa4014e936e91c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821278:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.821281:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936e923 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821286:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.821289:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936e923 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821304:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936e923 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821313:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936e923 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821320:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ef62a31/0xb1aa4014e936e923 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.821330:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.821331:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.821333:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.821340:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.821346:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779374.821686:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.821692:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b5c4069/0xb1aa4014e936e92a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.821701:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.821704:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.821709:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b5c4069/0xb1aa4014e936e92a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.821718:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b5c4069/0xb1aa4014e936e92a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.821726:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b5c4069/0xb1aa4014e936e92a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.821734:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b5c4069/0xb1aa4014e936e92a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.821794:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790779374.822093:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.822099:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b71c065/0xb1aa4014e936e931 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.822107:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.822110:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.822114:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b71c065/0xb1aa4014e936e931 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.822122:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b71c065/0xb1aa4014e936e931 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.822130:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b71c065/0xb1aa4014e936e931 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.822137:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b71c065/0xb1aa4014e936e931 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822183:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779374.822190:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b5c4069/0xb1aa4014e936e92a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822197:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.822201:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b5c4069/0xb1aa4014e936e92a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822209:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b5c4069/0xb1aa4014e936e92a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822223:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b5c4069/0xb1aa4014e936e92a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822240:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b5c4069/0xb1aa4014e936e92a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779374.822247:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.822252:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008868d23f/0xb1aa4014e936e938 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822258:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790779374.822260:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.822261:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b71c065/0xb1aa4014e936e931 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.822267:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.822268:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.822271:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b71c065/0xb1aa4014e936e931 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.822272:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008868d23f/0xb1aa4014e936e938 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822280:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b71c065/0xb1aa4014e936e931 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.822283:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008868d23f/0xb1aa4014e936e938 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822290:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b71c065/0xb1aa4014e936e931 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.822291:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008868d23f/0xb1aa4014e936e938 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822299:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.822300:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008868d23f/0xb1aa4014e936e938 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822301:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.822303:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.822310:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790779374.822314:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.822318:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008868d23f/0xb1aa4014e936e938 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822324:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.822333:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008868d23f/0xb1aa4014e936e938 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822341:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008868d23f/0xb1aa4014e936e938 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822352:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008868d23f/0xb1aa4014e936e938 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822359:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008868d23f/0xb1aa4014e936e938 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822370:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.822372:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.822374:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.822497:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790779374.822502:0:24695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b71c065/0xb1aa4014e936e931 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779374.822801:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.822807:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936e93f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.822822:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.822826:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.822830:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936e93f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.822840:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936e93f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.822848:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936e93f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.822856:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936e93f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822902:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.822908:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936e93f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822915:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.822919:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936e93f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822927:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936e93f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822939:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936e93f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.822954:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.822956:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.822957:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.823042:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790779374.823047:0:24695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cb04060/0xb1aa4014e936e93f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779374.823357:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.823363:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ea9b354/0xb1aa4014e936e946 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.823372:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.823386:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.823390:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ea9b354/0xb1aa4014e936e946 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.823410:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ea9b354/0xb1aa4014e936e946 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.823419:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ea9b354/0xb1aa4014e936e946 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.823427:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ea9b354/0xb1aa4014e936e946 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.823512:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.823517:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ea9b354/0xb1aa4014e936e946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.823524:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.823528:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ea9b354/0xb1aa4014e936e946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.823535:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ea9b354/0xb1aa4014e936e946 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.823547:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ea9b354/0xb1aa4014e936e946 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.823554:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.823556:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.823558:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779374.823808:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790779374.823814:0:24695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ea9b354/0xb1aa4014e936e946 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790779374.824159:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.824166:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a45740/0xb1aa4014e936e94d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.824175:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.824178:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.824182:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031a45740/0xb1aa4014e936e94d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790779374.824193:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.824193:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031a45740/0xb1aa4014e936e94d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.824199:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936e954 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.824201:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a45740/0xb1aa4014e936e94d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.824207:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.824210:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.824215:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936e954 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.824215:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031a45740/0xb1aa4014e936e94d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.824224:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936e954 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.824245:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936e954 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.824253:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936e954 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.824551:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779374.824559:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031a45740/0xb1aa4014e936e94d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.824568:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769e00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.824572:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a45740/0xb1aa4014e936e94d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.824588:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a45740/0xb1aa4014e936e94d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.824601:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031a45740/0xb1aa4014e936e94d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.824611:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.824615:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936e954 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.824622:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.824626:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936e954 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.824633:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936e954 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.824644:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936e954 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.824653:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.824656:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.824658:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790779374.824714:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790779374.824720:0:24218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031a45740/0xb1aa4014e936e94d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.824736:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790779374.824740:0:24695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd54af34/0xb1aa4014e936e954 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.825057:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.825065:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790779374.825473:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.825481:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7fd23c/0xb1aa4014e936e95b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.825494:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.825498:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.825503:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7fd23c/0xb1aa4014e936e95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.825515:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd7fd23c/0xb1aa4014e936e95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.825523:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7fd23c/0xb1aa4014e936e95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.825531:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7fd23c/0xb1aa4014e936e95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.825557:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790779374.826091:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.826098:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936e962 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.826107:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.826111:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.826115:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936e962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.826124:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936e962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.826132:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936e962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.826140:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936e962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.826154:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790779374.826377:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790779374.826383:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a787964/0xb1aa4014e936e969 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.826392:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=692s v=(0 0) 00010000:00010000:0.0:1790779374.826403:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779374.826407:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a787964/0xb1aa4014e936e969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.826416:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a787964/0xb1aa4014e936e969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.826424:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a787964/0xb1aa4014e936e969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.826432:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a787964/0xb1aa4014e936e969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779374.826445:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1790779374.826703:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790779374.826712:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef29cb54/0xb1aa4014e936e970 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.826729:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=692s v=(0 0) 00010000:00010000:1.0:1790779374.826733:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790779374.826737:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef29cb54/0xb1aa4014e936e970 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.826750:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef29cb54/0xb1aa4014e936e970 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.826758:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef29cb54/0xb1aa4014e936e970 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.826765:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef29cb54/0xb1aa4014e936e970 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.826774:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1790779374.826921:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790779374.826928:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd7fd23c/0xb1aa4014e936e95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.826935:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779374.826939:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7fd23c/0xb1aa4014e936e95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.827874:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7fd23c/0xb1aa4014e936e95b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.827942:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd7fd23c/0xb1aa4014e936e95b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779374.827970:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790779374.828026:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd7fd23c/0xb1aa4014e936e95b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828047:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790779374.828053:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936e962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828061:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779374.828064:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936e962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828073:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936e962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828085:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936e962 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828092:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5ea466a/0xb1aa4014e936e962 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828106:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790779374.828110:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a787964/0xb1aa4014e936e969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828123:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779374.828127:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a787964/0xb1aa4014e936e969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828135:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a787964/0xb1aa4014e936e969 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828147:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a787964/0xb1aa4014e936e969 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828155:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a787964/0xb1aa4014e936e969 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828169:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779374.828174:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef29cb54/0xb1aa4014e936e970 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828182:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779374.828185:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef29cb54/0xb1aa4014e936e970 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828193:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef29cb54/0xb1aa4014e936e970 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828202:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef29cb54/0xb1aa4014e936e970 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828216:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef29cb54/0xb1aa4014e936e970 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.828232:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779374.828235:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779374.828237:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779374.828258:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779374.828265:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.828452:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003302b49e/0xb1aa4014e936e977 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.828465:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.828469:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.828474:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003302b49e/0xb1aa4014e936e977 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.828485:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003302b49e/0xb1aa4014e936e977 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.828494:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003302b49e/0xb1aa4014e936e977 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.828503:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003302b49e/0xb1aa4014e936e977 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.828524:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779374.828856:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779374.828862:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b8f4cba/0xb1aa4014e936e97e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.828870:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.828873:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.828896:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b8f4cba/0xb1aa4014e936e97e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.828907:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b8f4cba/0xb1aa4014e936e97e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.828923:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b8f4cba/0xb1aa4014e936e97e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.828930:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b8f4cba/0xb1aa4014e936e97e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.828948:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790779374.829111:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790779374.829119:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003302b49e/0xb1aa4014e936e977 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.829129:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602670a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779374.829134:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003302b49e/0xb1aa4014e936e977 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.829144:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003302b49e/0xb1aa4014e936e977 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.829158:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003302b49e/0xb1aa4014e936e977 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.829167:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003302b49e/0xb1aa4014e936e977 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.829323:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779374.829334:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b8f4cba/0xb1aa4014e936e97e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.829342:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602670000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779374.829346:0:25050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b8f4cba/0xb1aa4014e936e97e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.829356:0:25050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b8f4cba/0xb1aa4014e936e97e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.829450:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b8f4cba/0xb1aa4014e936e97e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.829458:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b8f4cba/0xb1aa4014e936e97e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779374.829474:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779374.829476:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779374.829546:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790779374.830456:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.830464:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936e985 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.830477:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.830481:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.830486:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936e985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.830496:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936e985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.830505:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936e985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.830526:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936e985 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.830540:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790779374.830932:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.830938:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936e98c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.830947:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.830950:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.830954:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936e98c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.830963:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936e98c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.830971:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936e98c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.830989:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936e98c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.831005:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790779374.831310:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.831315:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936e993 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.831329:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.831332:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.831336:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936e993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.831345:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936e993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.831353:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936e993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.831359:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936e993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.831367:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790779374.831678:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779374.831684:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000453e39cb/0xb1aa4014e936e99a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831693:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.831696:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.831700:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000453e39cb/0xb1aa4014e936e99a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831710:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000453e39cb/0xb1aa4014e936e99a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831717:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000453e39cb/0xb1aa4014e936e99a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831724:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000453e39cb/0xb1aa4014e936e99a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831743:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1790779374.831851:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790779374.831859:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936e985 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831867:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.831870:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936e985 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831898:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936e985 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831917:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936e985 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831924:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005637871d/0xb1aa4014e936e985 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831945:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790779374.831948:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936e98c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831954:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.831957:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936e98c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831978:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936e98c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.831996:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936e98c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832004:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050c695d0/0xb1aa4014e936e98c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832029:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779374.832033:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936e993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832039:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.832042:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936e993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832049:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936e993 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832058:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936e993 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832065:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fe18cbe/0xb1aa4014e936e993 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832088:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.832092:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000453e39cb/0xb1aa4014e936e99a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832099:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.832102:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000453e39cb/0xb1aa4014e936e99a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832109:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000453e39cb/0xb1aa4014e936e99a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832119:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000453e39cb/0xb1aa4014e936e99a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832127:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000453e39cb/0xb1aa4014e936e99a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832139:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.832141:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.832143:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790779374.832370:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779374.832442:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e9a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832454:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.832463:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.832468:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e9a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832479:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e9a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832487:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e9a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832495:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e9a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832510:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790779374.832775:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779374.832781:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f518c7b/0xb1aa4014e936e9a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832790:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.832792:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.832796:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f518c7b/0xb1aa4014e936e9a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832804:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f518c7b/0xb1aa4014e936e9a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832812:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f518c7b/0xb1aa4014e936e9a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832824:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f518c7b/0xb1aa4014e936e9a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.832833:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790779374.833276:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.833282:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936e9af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.833290:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.833293:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.833297:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936e9af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.833305:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936e9af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.833323:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936e9af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.833329:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936e9af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.833338:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790779374.833705:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779374.833711:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a9a94cc/0xb1aa4014e936e9b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.833720:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.833723:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.833727:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a9a94cc/0xb1aa4014e936e9b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.833735:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a9a94cc/0xb1aa4014e936e9b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.833743:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a9a94cc/0xb1aa4014e936e9b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.833751:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a9a94cc/0xb1aa4014e936e9b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.833759:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1790779374.834082:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779374.834087:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caefeb00/0xb1aa4014e936e9bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.834101:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.834104:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.834108:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caefeb00/0xb1aa4014e936e9bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.834116:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caefeb00/0xb1aa4014e936e9bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.834124:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caefeb00/0xb1aa4014e936e9bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.834131:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000caefeb00/0xb1aa4014e936e9bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.834140:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1790779374.834432:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.834438:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ae8847/0xb1aa4014e936e9c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.834446:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.834450:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.834454:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ae8847/0xb1aa4014e936e9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.834463:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5ae8847/0xb1aa4014e936e9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.834471:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ae8847/0xb1aa4014e936e9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.834479:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ae8847/0xb1aa4014e936e9c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.834498:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1790779374.834810:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.834817:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009f2c497/0xb1aa4014e936e9cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.834826:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.834830:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.834833:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009f2c497/0xb1aa4014e936e9cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.834842:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009f2c497/0xb1aa4014e936e9cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.834850:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009f2c497/0xb1aa4014e936e9cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.834858:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009f2c497/0xb1aa4014e936e9cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.834865:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1790779374.835171:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779374.835177:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784b065b/0xb1aa4014e936e9d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.835184:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.835187:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.835191:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000784b065b/0xb1aa4014e936e9d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.835199:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000784b065b/0xb1aa4014e936e9d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.835218:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784b065b/0xb1aa4014e936e9d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.835225:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000784b065b/0xb1aa4014e936e9d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.835233:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1790779374.835551:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.835558:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003915a468/0xb1aa4014e936e9d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.835565:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.835574:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.835578:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003915a468/0xb1aa4014e936e9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.835587:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003915a468/0xb1aa4014e936e9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.835595:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003915a468/0xb1aa4014e936e9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.835603:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003915a468/0xb1aa4014e936e9d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.835611:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1790779374.835873:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.835898:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e9e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.835907:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.835909:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.835913:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.835923:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.835930:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.835944:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e9e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.835952:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1790779374.836105:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779374.836111:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028045f9b/0xb1aa4014e936e9e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.836119:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.836122:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.836125:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028045f9b/0xb1aa4014e936e9e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.836134:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028045f9b/0xb1aa4014e936e9e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.836141:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028045f9b/0xb1aa4014e936e9e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.836148:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028045f9b/0xb1aa4014e936e9e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.836166:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1790779374.836648:0:24695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790779374.836654:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e9ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.836663:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=692s v=(0 0) 00010000:00010000:3.0:1790779374.836666:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779374.836669:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e9ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.836678:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e9ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.836686:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e9ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.836694:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e9ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779374.836702:0:24695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00080000:3.0:1790779374.836732:0:24695:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:3.0:1790779374.836841:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22736:x1877767663904128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 72013us (72079us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779374.836858:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779374.836933:0:22736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1877767663904128:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790779374.836948:0:22736:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00002000:00010000:2.0:1790779374.837106:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779374.837111:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228ddba6/0xb1aa4014e936e9f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.837120:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.837123:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.837127:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000228ddba6/0xb1aa4014e936e9f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.837135:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000228ddba6/0xb1aa4014e936e9f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.837142:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228ddba6/0xb1aa4014e936e9f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.837149:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000228ddba6/0xb1aa4014e936e9f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.837157:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1790779374.838142:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779374.838151:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf764b9/0xb1aa4014e936e9fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838164:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.838175:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.838180:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf764b9/0xb1aa4014e936e9fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838190:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bf764b9/0xb1aa4014e936e9fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838200:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf764b9/0xb1aa4014e936e9fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838207:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bf764b9/0xb1aa4014e936e9fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838216:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00010000:00010000:2.0:1790779374.838261:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1790779374.838268:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e9a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838275:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602670400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.838279:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e9a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838288:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e9a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838303:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e9a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838320:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a7d147e/0xb1aa4014e936e9a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838339:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1790779374.838343:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f518c7b/0xb1aa4014e936e9a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838349:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7602671200 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.838351:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f518c7b/0xb1aa4014e936e9a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838359:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f518c7b/0xb1aa4014e936e9a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838368:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f518c7b/0xb1aa4014e936e9a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.838374:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f518c7b/0xb1aa4014e936e9a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779374.838492:0:22736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1877767663905024:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790779374.838549:0:22736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779374.838587:0:22736:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77342c06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779374.838606:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663905024 00000100:00100000:3.0:1790779374.838613:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663905024 00000100:00100000:3.0:1790779374.838657:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790779374.838666:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22736:x1877767663905024:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790779374.838709:0:24695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:2.0:1790779374.839499:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1790779374.839505:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936e9af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839514:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.839524:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936e9af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839533:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936e9af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839548:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936e9af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839556:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f0616d/0xb1aa4014e936e9af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839572:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1790779374.839577:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a9a94cc/0xb1aa4014e936e9b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839584:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe9a00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.839587:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a9a94cc/0xb1aa4014e936e9b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839595:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a9a94cc/0xb1aa4014e936e9b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839605:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a9a94cc/0xb1aa4014e936e9b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839613:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a9a94cc/0xb1aa4014e936e9b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839632:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1790779374.839636:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000caefeb00/0xb1aa4014e936e9bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839642:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe9400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.839646:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000caefeb00/0xb1aa4014e936e9bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839654:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000caefeb00/0xb1aa4014e936e9bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839665:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000caefeb00/0xb1aa4014e936e9bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839672:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caefeb00/0xb1aa4014e936e9bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839683:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1790779374.839687:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5ae8847/0xb1aa4014e936e9c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839694:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.839697:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ae8847/0xb1aa4014e936e9c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839715:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ae8847/0xb1aa4014e936e9c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839726:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5ae8847/0xb1aa4014e936e9c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839733:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5ae8847/0xb1aa4014e936e9c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839747:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1790779374.839751:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009f2c497/0xb1aa4014e936e9cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839758:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.839760:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009f2c497/0xb1aa4014e936e9cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839769:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009f2c497/0xb1aa4014e936e9cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839778:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009f2c497/0xb1aa4014e936e9cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839785:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009f2c497/0xb1aa4014e936e9cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839808:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1790779374.839812:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000784b065b/0xb1aa4014e936e9d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839819:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe9600 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.839822:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000784b065b/0xb1aa4014e936e9d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839830:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000784b065b/0xb1aa4014e936e9d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839840:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000784b065b/0xb1aa4014e936e9d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839848:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000784b065b/0xb1aa4014e936e9d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839860:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790779374.839864:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003915a468/0xb1aa4014e936e9d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839870:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663e00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.839873:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003915a468/0xb1aa4014e936e9d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839909:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003915a468/0xb1aa4014e936e9d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839921:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003915a468/0xb1aa4014e936e9d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839927:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003915a468/0xb1aa4014e936e9d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839941:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790779374.839945:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e9e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839952:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a3400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.839955:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e9e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839962:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e9e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839970:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e9e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.839977:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000671caf0/0xb1aa4014e936e9e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842752:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790779374.842760:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028045f9b/0xb1aa4014e936e9e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842769:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe9e00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.842773:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028045f9b/0xb1aa4014e936e9e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842784:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028045f9b/0xb1aa4014e936e9e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842802:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028045f9b/0xb1aa4014e936e9e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842808:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028045f9b/0xb1aa4014e936e9e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842821:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790779374.842825:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e9ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842830:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894a400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.842833:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e9ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842851:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e9ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842863:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e9ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842869:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034ca1e1f/0xb1aa4014e936e9ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842900:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779374.842904:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000228ddba6/0xb1aa4014e936e9f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842909:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe9800 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.842912:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000228ddba6/0xb1aa4014e936e9f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842918:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000228ddba6/0xb1aa4014e936e9f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842928:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000228ddba6/0xb1aa4014e936e9f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842935:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000228ddba6/0xb1aa4014e936e9f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842960:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.842964:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bf764b9/0xb1aa4014e936e9fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.842971:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe8c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.842974:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf764b9/0xb1aa4014e936e9fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.843734:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf764b9/0xb1aa4014e936e9fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.843750:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bf764b9/0xb1aa4014e936e9fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.843758:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bf764b9/0xb1aa4014e936e9fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.843776:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.843778:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.843781:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779374.844052:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779374.844123:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790779374.846432:0:25031:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1790779374.846468:0:25031:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1790779374.846475:0:25031:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790779374.846765:0:24217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23455:x1877767663904896:12345-0@lo:5:osp-pre-1-1.0 Request processed in 63146us (63189us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1790779374.846777:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790779374.847357:0:23455:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1790779374.847367:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23455:1877767663904896:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1790779374.847390:0:23455:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1790779374.847453:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23455:1877767663905152:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1790779374.847494:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779374.847516:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d78e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790779374.847811:0:22722:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663905152 00000100:00100000:3.0:1790779374.847819:0:22722:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663905152 00000100:00100000:3.0:1790779374.847866:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790779374.847875:0:22722:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23455:x1877767663905152:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1790779374.847964:0:22722:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23455:x1877767663905152:12345-0@lo:900:osp-pre-1-1.0 Request processed in 90us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779374.847971:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790779374.848076:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b773f4f4a80 x1877767663905152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790779390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779374.848087:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23455:1877767663905152:0@lo:900:osp-pre-1-1.0 00000001:00080000:1.0:1790779374.848712:0:24212:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1790779374.848751:0:24212:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1790779374.849403:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790779374.849412:0:24218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ccc95d/0xb1aa4014e936ea03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.849429:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=692s v=(0 0) 00010000:00010000:2.0:1790779374.849439:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779374.849446:0:24218:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ccc95d/0xb1aa4014e936ea03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.849461:0:24218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0ccc95d/0xb1aa4014e936ea03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.849471:0:24218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ccc95d/0xb1aa4014e936ea03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.849479:0:24218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ccc95d/0xb1aa4014e936ea03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.849497:0:24218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1790779374.849743:0:24218:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1790779374.849820:0:24218:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22738:x1877767663904384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 77989us (84550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779374.849830:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1790779374.849856:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779374.849863:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0ccc95d/0xb1aa4014e936ea03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.849871:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe8400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779374.849876:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ccc95d/0xb1aa4014e936ea03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.849916:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ccc95d/0xb1aa4014e936ea03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.849940:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0ccc95d/0xb1aa4014e936ea03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.849947:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0ccc95d/0xb1aa4014e936ea03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779374.849964:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.849966:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779374.849968:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779374.850328:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1877767663904384:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790779374.850343:0:22738:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1790779374.850448:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b769500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1877767663905280:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790779374.850484:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779374.850523:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77342c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1790779374.850645:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22736:x1877767663905024:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11979us (12094us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1790779374.850654:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790779374.850672:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663905280 00000100:00100000:3.0:1790779374.850677:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663905280 00000100:00100000:3.0:1790779374.850717:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790779374.850726:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22738:x1877767663905280:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790779374.850760:0:24695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1790779374.856266:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22738:x1877767663905280:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5534us (5773us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1790779374.856281:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790779374.856344:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b769500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1877767663905280:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790779374.856361:0:22738:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:2.0:1790779374.856582:0:22736:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1790779374.856590:0:22736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1877767663905024:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790779374.856602:0:22736:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:1.0:1790779374.952136:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790779375.404448:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1790779375.784052:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790779375.784060:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b770ea1b000 from 14 10000000:01000000:2.0:1790779375.784066:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790779375.784110:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7736fe9e00/0xb1aa4014e936ea0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779375.784122:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7736fe9e00/0xb1aa4014e936ea0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779375.784192:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7736fe9e00/0xb1aa4014e936ea0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779375.784217:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663905408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790779375.784279:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779375.784374:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854b600 going to sleep for 11 seconds 00000100:00100000:0.0:1790779375.788097:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663905408 00000100:00100000:0.0:1790779375.788110:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663905408 00000100:00100000:0.0:1790779375.788264:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790779375.788275:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+22:22707:x1877767663905408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779375.788293:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779375.788312:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769000/0xb1aa4014e936ea11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ea0a expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779375.788339:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769000/0xb1aa4014e936ea11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ea0a expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779375.788352:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769000/0xb1aa4014e936ea11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ea0a expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779375.788377:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769000, rc 0) 00000100:00100000:0.0:1790779375.788512:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+23:22707:x1877767663905408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (4231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779375.788519:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790779375.788834:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663905408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779375.788852:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7736fe9e00/0xb1aa4014e936ea0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ea11 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779375.788862:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7736fe9e00/0xb1aa4014e936ea0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ea11 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779375.789335:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663905536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790779375.789378:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779375.789510:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7727a4ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779375.789549:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663905536 00000100:00100000:0.0:1790779375.789554:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663905536 00000100:00100000:0.0:1790779375.789614:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790779375.789621:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+23:22707:x1877767663905536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790779375.789638:0:22703:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790779375.789653:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790779375.789656:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1790779375.789742:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+23:22707:x1877767663905536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779375.789749:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790779375.789812:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663905536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790779375.789871:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790779375.789907:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7736fe9e00/0xb1aa4014e936ea0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ea11 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779375.789916:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7736fe9e00/0xb1aa4014e936ea0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ea11 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790779375.789937:0:22707:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790779375.789939:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b773c016000 from 14 10000000:01000000:3.0:1790779375.789941:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790779375.789961:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ea18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779375.789968:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ea18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779375.789984:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ea18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779375.789997:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663905664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790779375.790030:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779375.790335:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77014b0480 going to sleep for 11 seconds 00000100:00100000:2.0:1790779375.790394:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663905664 00000100:00100000:2.0:1790779375.790399:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663905664 00000100:00100000:2.0:1790779375.790419:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790779375.790425:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+23:22707:x1877767663905664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779375.790433:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779375.790442:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7736fe9600/0xb1aa4014e936ea1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936ea18 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779375.790459:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7736fe9600/0xb1aa4014e936ea1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936ea18 expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779375.790468:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7736fe9600/0xb1aa4014e936ea1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936ea18 expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779375.790475:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe9600, rc 0) 00000100:00100000:2.0:1790779375.790510:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+24:22707:x1877767663905664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779375.790516:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790779375.790585:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663905664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779375.790604:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ea18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ea1f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779375.790612:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ea18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936ea1f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779375.790649:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663905792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790779375.790677:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779375.790700:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77014b0480 going to sleep for 11 seconds 00000100:00100000:0.0:1790779375.790731:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663905792 00000100:00100000:0.0:1790779375.790735:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663905792 00000100:00100000:0.0:1790779375.790754:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790779375.790759:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:22707:x1877767663905792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790779375.790768:0:22703:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790779375.790778:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790779375.790781:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1790779375.790849:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:22707:x1877767663905792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779375.790855:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790779375.790945:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663905792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790779375.790994:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790779375.791001:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ea18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ea1f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779375.791018:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b770894a400/0xb1aa4014e936ea18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936ea1f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779375.979993:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790779377.001386:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779378.024053:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779378.283294:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663905920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779378.283396:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779378.283688:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663905920 00000100:00100000:3.0:1790779378.283712:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663905920 00000100:00100000:3.0:1790779378.283796:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779378.283813:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663905920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790779378.283855:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00080000:0.0:1790779378.283920:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779378.283959:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663905920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 154us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779378.283967:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790779378.284053:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663905920:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790779379.051208:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779379.304503:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790779379.304651:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663906048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790779379.304819:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779379.304916:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663906048 00000100:00100000:1.0:1790779379.304927:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663906048 00000100:00100000:1.0:1790779379.305014:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790779379.305025:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663906048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779379.305073:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790779379.305128:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663906048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779379.305136:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790779379.305196:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663906048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779379.816006:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663906176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779379.816089:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779379.816158:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663906176 00000100:00100000:0.0:1790779379.816166:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663906176 00000100:00100000:0.0:1790779379.816207:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790779379.816215:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663906176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779379.816241:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779379.816280:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1877767663906176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779379.816286:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1790779379.816304:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779379.816338:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663906176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779379.817115:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663906304:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.817152:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779379.817177:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663906816:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.817199:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779379.817216:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663907328:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.817236:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779379.817261:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790779379.817261:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663907328 00000100:00100000:0.0:1790779379.817266:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663907328 00000100:00100000:2.0:1790779379.817267:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663906688:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.817286:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779379.817300:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663906688 00000100:00100000:0.0:1790779379.817302:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663906688 00000100:00100000:2.0:1790779379.817310:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663907200:0@lo:400:kworker.0 00000100:00100000:0.0:1790779379.817320:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790779379.817327:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663907328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.817329:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779379.817339:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663907712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779379.817356:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779379.817361:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663907328:12345-0@lo:400:kworker.0 Request processed in 35us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779379.817368:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790779379.817379:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663907200 00010000:00080000:2.0:1790779379.817380:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cd880 x1877767663907328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790779379.817381:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663907200 00000100:00100000:2.0:1790779379.817391:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663907328:0@lo:400:kworker.0 00000100:00100000:0.0:1790779379.817395:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790779379.817417:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663906432:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.817439:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779379.817457:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663906944:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.817476:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779379.817493:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663907456:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.817510:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779379.817521:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790779379.817526:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663906560:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.817544:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779379.817560:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663907072:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.817578:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779379.817587:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663907584:0@lo:400:kworker.0 00000100:00100000:0.0:1790779379.817911:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663906688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779379.817953:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663906688:12345-0@lo:400:kworker.0 Request processed in 47us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779379.817960:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790779379.817995:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663907456 00000100:00100000:0.0:1790779379.817999:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663907456 00000100:00100000:0.0:1790779379.818014:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663907072 00000100:00100000:0.0:1790779379.818016:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663907072 00000100:00100000:0.0:1790779379.818043:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790779379.818048:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663907200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779379.818079:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663907200:12345-0@lo:400:kworker.0 Request processed in 30us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779379.818084:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790779379.818095:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790779379.818100:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663907456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779379.818124:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663907456:12345-0@lo:400:kworker.0 Request processed in 25us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779379.818129:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790779379.818140:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790779379.818144:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663907072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790779379.818168:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663907072:12345-0@lo:400:kworker.0 Request processed in 24us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779379.818172:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790779379.818189:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790779379.818192:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779379.820601:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779379.820669:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663906304 00000100:00100000:2.0:1790779379.820677:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663906304 00000100:00100000:2.0:1790779379.820729:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790779379.820738:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:3650:x1877767663906304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.820807:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:3650:x1877767663906304:12345-0@lo:400:kworker.0 Request processed in 70us (3653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779379.820814:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790779379.820845:0:24217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663906816 00000100:00100000:2.0:1790779379.820849:0:24217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663906816 00000100:00100000:2.0:1790779379.820870:0:24217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663906944 00000100:00100000:2.0:1790779379.820873:0:24217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663906944 00000100:00100000:2.0:1790779379.820917:0:24217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663906560 00000100:00100000:2.0:1790779379.820920:0:24217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663906560 00000100:00100000:2.0:1790779379.820935:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779379.820940:0:24217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663906816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.820985:0:24217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663906816:12345-0@lo:400:kworker.0 Request processed in 44us (3784us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779379.820991:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790779379.821003:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779379.821009:0:24217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663906944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.821036:0:24217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663906944:12345-0@lo:400:kworker.0 Request processed in 27us (3559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779379.821042:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790779379.821052:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779379.821058:0:24217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663906560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.821085:0:24217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663906560:12345-0@lo:400:kworker.0 Request processed in 27us (3540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779379.821090:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790779379.821108:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663907584 00000100:00100000:2.0:1790779379.821112:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663907584 00000100:00100000:2.0:1790779379.821138:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790779379.821151:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663907584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.821183:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663907584:12345-0@lo:400:kworker.0 Request processed in 33us (3578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779379.821189:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790779379.821211:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663907712 00000100:00100000:2.0:1790779379.821229:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663907712 00000100:00100000:2.0:1790779379.821247:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663906432 00000100:00100000:2.0:1790779379.821250:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663906432 00000100:00100000:2.0:1790779379.821261:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790779379.821267:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1877767663907712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790779379.821291:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790779379.821319:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1877767663907712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (3962us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779379.821325:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790779379.821335:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790779379.821341:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663906432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.821367:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663906432:12345-0@lo:400:kworker.0 Request processed in 26us (3927us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779379.821372:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790779379.821427:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779379.821438:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663907968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779379.821472:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779379.821498:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790779379.821506:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663907840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790779379.821530:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790779379.821592:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cc000 x1877767663906688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779379.821619:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663906688:0@lo:400:kworker.0 00010000:00080000:2.0:1790779379.821635:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cca80 x1877767663907200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779379.821644:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663907200:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.821659:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663907712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779379.821668:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663906304:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.821678:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663906816:0@lo:400:kworker.0 00010000:00080000:2.0:1790779379.821723:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760300ad80 x1877767663907584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779379.821731:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663907584:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.821739:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663906432:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.822090:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663906944:0@lo:400:kworker.0 00010000:00080000:2.0:1790779379.822109:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b760300b800 x1877767663907456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779379.822118:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663907456:0@lo:400:kworker.0 00000100:00100000:2.0:1790779379.822139:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663906560:0@lo:400:kworker.0 00010000:00080000:2.0:1790779379.822149:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cf800 x1877767663907072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779379.822155:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663907072:0@lo:400:kworker.0 00000100:00080000:0.0:1790779379.822544:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790779379.822550:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790779379.822552:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779379.822565:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663907968 00000100:00100000:0.0:1790779379.822570:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663907968 00000100:00100000:0.0:1790779379.822592:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663907840 00000100:00100000:0.0:1790779379.822595:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663907840 00000100:00100000:0.0:1790779379.822676:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779379.822691:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663907968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790779379.822710:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790779379.822776:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663907968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779379.822782:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790779379.822796:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790779379.822803:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663907840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790779379.822812:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790779379.822863:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663907968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790779379.823328:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663907840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 524us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779379.823335:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790779379.823495:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663907840:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1790779379.937787:0:25390:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg303-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790779380.073021:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790779380.811401:0:25442:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779380.811595:0:25442:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:3.0:1790779380.853704:0:25031:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1790779381.107980:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790779381.666111:0:25492:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790779381.666332:0:25492:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790779381.952316:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779381.955109:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642825472 00000100:00100000:1.0:1790779381.955124:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642825472 00000100:00100000:1.0:1790779381.955310:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:1.0:1790779381.955318:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1877767642825472:12345-192.168.203.3@tcp:250:mount.lustre.0 00010000:00080000:1.0:1790779381.955346:0:22704:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 665a1626-0317-4a55-b618-c653e5716dd5@192.168.203.3@tcp t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:1.0:1790779381.955388:0:22704:0:(genops.c:1384:class_connect()) connect: client 665a1626-0317-4a55-b618-c653e5716dd5, cookie 0xb1aa4014e936ea26 00000100:00080000:1.0:1790779381.955544:0:22704:0:(import.c:65:import_set_state_nolock()) ffff9b76031a3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790779381.955642:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+5:2397:x1877767642825472:12345-192.168.203.3@tcp:250:mount.lustre.0 Request processed in 314us (3326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779381.955650:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 115 00000100:00100000:3.0:1790779381.962430:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779381.962730:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642825600 00000100:00100000:2.0:1790779381.962741:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642825600 00000100:00100000:2.0:1790779381.962864:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:2.0:1790779381.962874:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+5:18029:x1877767642825600:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790779381.962926:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779381.962943:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7736fe8800/0xb1aa4014e936ea2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425d29 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779381.962985:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7736fe8800/0xb1aa4014e936ea2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d29 expref: 6 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779381.962996:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7736fe8800/0xb1aa4014e936ea2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d29 expref: 6 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779381.963005:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe8800, rc 0) 00000100:00100000:2.0:1790779381.963061:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+6:18029:x1877767642825600:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 189us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779381.963069:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 116 00000100:00100000:0.0:1790779381.972020:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779381.972229:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642825728 00000100:00100000:1.0:1790779381.972240:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642825728 00000100:00100000:1.0:1790779381.972301:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:1.0:1790779381.972310:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+6:18029:x1877767642825728:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790779381.972442:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+6:18029:x1877767642825728:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 133us (431us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790779381.972450:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 117 00000100:00100000:1.0:1790779381.974998:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779381.975085:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642825856 00000100:00100000:0.0:1790779381.975095:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642825856 00000100:00100000:0.0:1790779381.975235:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:0.0:1790779381.975245:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+6:18029:x1877767642825856:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790779381.975262:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779381.975278:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769800/0xb1aa4014e936ea34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425d30 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779381.975306:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769800/0xb1aa4014e936ea34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d30 expref: 7 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779381.975317:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769800/0xb1aa4014e936ea34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d30 expref: 7 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779381.975345:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769800, rc 0) 00000100:00100000:0.0:1790779381.975410:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+7:18029:x1877767642825856:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 166us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779381.975417:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 118 00000100:00100000:3.0:1790779381.981991:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779381.982065:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642825984 00000100:00100000:2.0:1790779381.982088:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642825984 00000100:00100000:2.0:1790779381.982154:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:2.0:1790779381.982163:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+7:18029:x1877767642825984:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790779381.982343:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+8:18029:x1877767642825984:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 180us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779381.982351:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 119 00000100:00100000:2.0:1790779381.987976:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779381.988140:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642826112 00000100:00100000:0.0:1790779381.988151:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642826112 00000100:00100000:0.0:1790779381.988861:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:0.0:1790779381.988875:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+8:18029:x1877767642826112:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790779381.989085:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+8:18029:x1877767642826112:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 213us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779381.989093:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 120 00000100:00100000:3.0:1790779381.999913:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779382.000343:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642826240 00000100:00100000:1.0:1790779382.000353:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642826240 00000100:00100000:1.0:1790779382.000598:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:1.0:1790779382.000609:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+8:18047:x1877767642826240:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790779382.000776:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+8:18047:x1877767642826240:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 168us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779382.000785:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 121 00000100:00100000:3.0:1790779382.026491:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779382.026667:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642826368 00000100:00100000:2.0:1790779382.026677:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642826368 00000100:00100000:2.0:1790779382.026789:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:2.0:1790779382.026799:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773435b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+8:18047:x1877767642826368:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779382.026993:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773435b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+8:18047:x1877767642826368:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 194us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.027001:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 122 00000100:00100000:2.0:1790779382.033843:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779382.035970:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642826496 00000100:00100000:1.0:1790779382.035985:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642826496 00000100:00100000:1.0:1790779382.036096:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:1.0:1790779382.036105:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773435a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+8:18047:x1877767642826496:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790779382.036316:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773435a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+8:18047:x1877767642826496:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 211us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779382.036330:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 123 00000100:00100000:3.0:1790779382.045127:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779382.046060:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642826624 00000100:00100000:2.0:1790779382.046072:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642826624 00000100:00100000:2.0:1790779382.046130:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:2.0:1790779382.046140:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+8:18029:x1877767642826624:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790779382.046156:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779382.046172:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7736fe9200/0xb1aa4014e936ea3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425d61 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779382.046200:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7736fe9200/0xb1aa4014e936ea3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d61 expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779382.046213:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7736fe9200/0xb1aa4014e936ea3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d61 expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779382.046235:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe9200, rc 0) 00000100:00100000:2.0:1790779382.046308:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+9:18029:x1877767642826624:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 168us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.046316:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 124 00000100:00100000:3.0:1790779382.059215:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779382.062125:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642826752 00000100:00100000:1.0:1790779382.062141:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642826752 00000100:00100000:1.0:1790779382.062212:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:1.0:1790779382.062223:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+9:18029:x1877767642826752:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790779382.062246:0:22704:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790779382.062268:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790779382.062272:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790779382.062274:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790779382.062277:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1790779382.062279:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1790779382.066235:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+9:18029:x1877767642826752:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 4002us (7017us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.066250:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 125 00000100:00100000:3.0:1790779382.071426:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779382.071540:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642826880 00000100:00100000:0.0:1790779382.071551:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642826880 00000100:00100000:0.0:1790779382.071608:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:0.0:1790779382.071618:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+9:18029:x1877767642826880:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790779382.071634:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779382.071650:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ea42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425d68 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779382.071687:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ea42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d68 expref: 10 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779382.071698:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ea42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d68 expref: 10 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779382.071707:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769200, rc 0) 00000100:00100000:0.0:1790779382.071777:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+10:18029:x1877767642826880:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 161us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779382.071785:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 126 00000100:00100000:3.0:1790779382.079122:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779382.079297:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642827008 00000100:00100000:2.0:1790779382.079307:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642827008 00000100:00100000:2.0:1790779382.079418:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:2.0:1790779382.079429:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+10:18029:x1877767642827008:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790779382.079591:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+10:18029:x1877767642827008:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 164us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.079599:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 127 00000100:00100000:0.0:1790779382.081497:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779382.081639:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642827136 00000100:00100000:2.0:1790779382.081648:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642827136 00000100:00100000:2.0:1790779382.081696:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:2.0:1790779382.081705:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+10:18029:x1877767642827136:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790779382.082187:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+10:18029:x1877767642827136:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 461us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.082196:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 128 00000100:00100000:3.0:1790779382.093727:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779382.094137:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642827264 00000100:00100000:2.0:1790779382.094147:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642827264 00000100:00100000:2.0:1790779382.094200:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:2.0:1790779382.094224:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+10:18052:x1877767642827264:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779382.094379:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+10:18052:x1877767642827264:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 158us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.094387:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 129 00000100:00100000:1.0:1790779382.103060:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779382.108400:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642827392 00000100:00100000:2.0:1790779382.108415:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642827392 00000100:00100000:2.0:1790779382.108495:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 130 00000100:00100000:2.0:1790779382.108505:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+10:18052:x1877767642827392:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779382.108722:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+10:18052:x1877767642827392:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 218us (5671us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.108731:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 130 00010000:00010000:3.0:1790779382.120174:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779382.123207:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779382.123487:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642827520 00000100:00100000:2.0:1790779382.123497:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642827520 00000100:00100000:2.0:1790779382.123547:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1790779382.123555:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1877767642827520:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790779382.123585:0:22713:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5@192.168.203.3@tcp t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:2.0:1790779382.123636:0:22713:0:(genops.c:1384:class_connect()) connect: client 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5, cookie 0xb1aa4014e936ea49 00000004:00100000:2.0:1790779382.123660:0:22713:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790779382.123863:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9b7734581800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779382.123989:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2397:x1877767642827520:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 433us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.123997:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:3.0:1790779382.125182:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779382.125271:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642827776 00000100:00100000:0.0:1790779382.125278:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642827776 00000100:00100000:0.0:1790779382.125320:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:0.0:1790779382.125327:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1877767642827776:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790779382.125351:0:25109:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5@192.168.203.3@tcp t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:0.0:1790779382.125395:0:25109:0:(genops.c:1384:class_connect()) connect: client 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5, cookie 0xb1aa4014e936ea50 00000004:00100000:0.0:1790779382.125412:0:25109:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790779382.125585:0:25109:0:(import.c:65:import_set_state_nolock()) ffff9b7726aba000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779382.125639:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2397:x1877767642827776:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 310us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779382.125647:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:1.0:1790779382.128437:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779382.128479:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779382.128625:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642828032 00000100:00100000:2.0:1790779382.128635:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642828032 00000100:00100000:2.0:1790779382.128709:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642827648 00000100:00100000:2.0:1790779382.128725:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642827648 00000100:00100000:2.0:1790779382.128753:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:2.0:1790779382.128761:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:18029:x1877767642828032:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790779382.128799:0:22713:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790779382.128985:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1790779382.128995:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:0:x1877767642827648:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790779382.129008:0:25109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790779382.129049:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:0:x1877767642827648:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 56us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779382.129056:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:2.0:1790779382.129291:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18029:x1877767642828032:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 529us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.129299:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00080000:1.0:1790779382.129687:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779382.133320:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779382.133364:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779382.133450:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642827904 00000100:00100000:0.0:1790779382.133459:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642827904 00000100:00100000:0.0:1790779382.133532:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642828160 00000100:00100000:0.0:1790779382.133536:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642828160 00000100:00100000:0.0:1790779382.133565:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1790779382.133575:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:0:x1877767642827904:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790779382.133611:0:22712:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790779382.133689:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:0:x1877767642827904:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 115us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779382.133697:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1790779382.133714:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:0.0:1790779382.133733:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18029:x1877767642828160:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790779382.133766:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18029:x1877767642828160:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 35us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779382.133772:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00080000:1.0:1790779382.134677:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790779382.136997:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779382.138519:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779382.138614:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779382.138980:0:24217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642828288 00000100:00100000:2.0:1790779382.138994:0:24217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642828288 00000100:00100000:2.0:1790779382.139039:0:24217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642828416 00000100:00100000:2.0:1790779382.139043:0:24217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642828416 00000100:00100000:2.0:1790779382.139065:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:2.0:1790779382.139073:0:24217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1877767642828288:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790779382.139108:0:24217:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5@192.168.203.3@tcp t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:2.0:1790779382.139144:0:24217:0:(genops.c:1384:class_connect()) connect: client 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5, cookie 0xb1aa4014e936ea57 00002000:00100000:2.0:1790779382.139157:0:24217:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5/ffff9b7726b3c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790779382.139175:0:24217:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790779382.139407:0:24217:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790779382.139438:0:24217:0:(import.c:65:import_set_state_nolock()) ffff9b7726b38800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779382.139504:0:24217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2397:x1877767642828288:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 430us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.139512:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:2.0:1790779382.139531:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1790779382.139536:0:24217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1877767642828416:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790779382.139553:0:24217:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5@192.168.203.3@tcp t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:2.0:1790779382.139583:0:24217:0:(genops.c:1384:class_connect()) connect: client 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5, cookie 0xb1aa4014e936ea5e 00002000:00100000:2.0:1790779382.139589:0:24217:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5/ffff9b7726b3d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790779382.139601:0:24217:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790779382.139721:0:24217:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790779382.139739:0:24217:0:(import.c:65:import_set_state_nolock()) ffff9b7726b3f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779382.139780:0:24217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2397:x1877767642828416:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 241us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.139787:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1790779382.141454:0:22723:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642828544 00000100:00100000:1.0:1790779382.141466:0:22723:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642828544 00000100:00100000:1.0:1790779382.141533:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:1.0:1790779382.141544:0:22723:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18029:x1877767642828544:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:1.0:1790779382.141634:0:22723:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18029:x1877767642828544:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 92us (4645us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779382.141641:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:0.0:1790779382.149793:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779382.150073:0:22714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642828672 00000100:00100000:3.0:1790779382.150083:0:22714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642828672 00000100:00100000:3.0:1790779382.150135:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1790779382.150146:0:22714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18029:x1877767642828672:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00080000:0.0:1790779382.153971:0:22714:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3726us 00000004:00200000:3.0:1790779382.203233:0:22714:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790779382.203373:0:22714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18029:x1877767642828672:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 53225us (53584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779382.203397:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1790779382.420209:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779382.420305:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642828800 00000100:00100000:2.0:1790779382.420315:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642828800 00000100:00100000:2.0:1790779382.420377:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:2.0:1790779382.420387:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18075:x1877767642828800:12345-192.168.203.3@tcp:101:mkdir.0 00010000:00010000:2.0:1790779382.420408:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779382.420433:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8000/0xb1aa4014e936ea65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425d99 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779382.420497:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8a00/0xb1aa4014e936ea6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779382.420512:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8a00/0xb1aa4014e936ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779382.420527:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8a00/0xb1aa4014e936ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779382.420576:0:22712:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790779382.420580:0:22712:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779382.420615:0:22712:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8a00/0xb1aa4014e936ea6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779382.420654:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8000/0xb1aa4014e936ea65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d99 expref: 8 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779382.420671:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8a00/0xb1aa4014e936ea6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d99 expref: 7 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779382.420680:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617e00) 00010000:00010000:2.0:1790779382.420683:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779382.420686:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe8a00, rc 0) 00000100:00100000:2.0:1790779382.420751:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:18075:x1877767642828800:12345-192.168.203.3@tcp:101:mkdir.0 Request processed in 366us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779382.420758:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000040:00080000:3.0:1790779382.505111:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790779383.144152:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779383.401033:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663908096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790779383.401104:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779383.401332:0:24219:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663908096 00000100:00100000:3.0:1790779383.401342:0:24219:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663908096 00000100:00100000:3.0:1790779383.401408:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790779383.401417:0:24219:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663908096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790779383.401440:0:24219:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790779383.401494:0:24219:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663908096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779383.401501:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1790779383.401563:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790779383.401672:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663908096:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790779384.170912:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779384.326378:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779384.326564:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642828928 00000100:00100000:3.0:1790779384.326574:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642828928 00000100:00100000:3.0:1790779384.326649:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1790779384.326660:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:18127:x1877767642828928:12345-192.168.203.3@tcp:41:lfs.0 00000004:00000024:3.0:1790779384.326697:0:25109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790779384.326784:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:18127:x1877767642828928:12345-192.168.203.3@tcp:41:lfs.0 Request processed in 126us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.326791:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00080000:1.0:1790779384.327095:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779384.332779:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779384.332906:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642829056 00000100:00100000:2.0:1790779384.332924:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642829056 00000100:00100000:2.0:1790779384.333007:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1790779384.333019:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18127:x1877767642829056:12345-192.168.203.3@tcp:41:lfs.0 00000004:00000024:2.0:1790779384.333056:0:22712:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790779384.333150:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18127:x1877767642829056:12345-192.168.203.3@tcp:41:lfs.0 Request processed in 134us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.333158:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00080000:1.0:1790779384.333695:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790779384.335801:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779384.335909:0:24219:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642829184 00000100:00100000:3.0:1790779384.335927:0:24219:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642829184 00000100:00100000:3.0:1790779384.336007:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1790779384.336018:0:24219:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18127:x1877767642829184:12345-192.168.203.3@tcp:13:lfs.0 00002000:00000024:3.0:1790779384.336049:0:24219:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00080000:1.0:1790779384.336382:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779384.336419:0:24219:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18127:x1877767642829184:12345-192.168.203.3@tcp:13:lfs.0 Request processed in 403us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.336444:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:3.0:1790779384.341386:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779384.341485:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642829312 00000100:00100000:0.0:1790779384.341495:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642829312 00000100:00100000:0.0:1790779384.341562:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1790779384.341573:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18127:x1877767642829312:12345-192.168.203.3@tcp:13:lfs.0 00002000:00000024:0.0:1790779384.341604:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779384.341713:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18127:x1877767642829312:12345-192.168.203.3@tcp:13:lfs.0 Request processed in 142us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779384.341721:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00080000:1.0:1790779384.341789:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790779384.424532:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663908224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779384.424605:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779384.429048:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663908224 00000100:00100000:2.0:1790779384.429078:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663908224 00000100:00100000:2.0:1790779384.429224:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790779384.429235:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663908224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779384.429265:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790779384.429355:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663908224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (4749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.429363:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790779384.430187:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663908224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790779384.519542:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779384.519637:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642829440 00000100:00100000:0.0:1790779384.519647:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642829440 00000100:00100000:0.0:1790779384.519702:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:0.0:1790779384.519725:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+10:18159:x1877767642829440:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790779384.519741:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779384.519758:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ea73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425da0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779384.519787:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ea73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425da0 expref: 11 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779384.519798:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718769a00/0xb1aa4014e936ea73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425da0 expref: 11 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779384.519806:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769a00, rc 0) 00000100:00100000:0.0:1790779384.519984:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+11:18159:x1877767642829440:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 261us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779384.519991:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 131 00000100:00100000:2.0:1790779384.535595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779384.535691:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642829568 00000100:00100000:1.0:1790779384.535701:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642829568 00000100:00100000:1.0:1790779384.535757:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:1.0:1790779384.535766:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+11:18159:x1877767642829568:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790779384.535971:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+11:18159:x1877767642829568:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 204us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.535979:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 132 00000100:00100000:2.0:1790779384.540262:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779384.540358:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642829696 00000100:00100000:0.0:1790779384.540367:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642829696 00000100:00100000:0.0:1790779384.540469:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:0.0:1790779384.540480:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+11:18159:x1877767642829696:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790779384.540624:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+11:18159:x1877767642829696:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 146us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779384.540632:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 133 00000100:00100000:3.0:1790779384.555156:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779384.556496:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642829824 00000100:00100000:2.0:1790779384.556514:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642829824 00000100:00100000:2.0:1790779384.557467:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:2.0:1790779384.557490:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+11:18166:x1877767642829824:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779384.557728:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+11:18166:x1877767642829824:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 247us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.557736:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 134 00000100:00100000:2.0:1790779384.576542:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779384.576649:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642829952 00000100:00100000:0.0:1790779384.576662:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642829952 00000100:00100000:0.0:1790779384.576733:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:0.0:1790779384.576744:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+11:18166:x1877767642829952:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790779384.577066:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+11:18166:x1877767642829952:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 322us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779384.577083:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 135 00000100:00100000:3.0:1790779384.585557:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779384.585680:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642830080 00000100:00100000:2.0:1790779384.585694:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642830080 00000100:00100000:2.0:1790779384.585794:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:2.0:1790779384.585816:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+11:18166:x1877767642830080:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779384.586163:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+11:18166:x1877767642830080:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 357us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.586172:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 136 00000100:00100000:2.0:1790779384.595653:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779384.598361:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642830208 00000100:00100000:1.0:1790779384.598383:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642830208 00000100:00100000:1.0:1790779384.598846:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:1.0:1790779384.598867:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+11:18159:x1877767642830208:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790779384.598909:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779384.598933:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936ea7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425dd1 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779384.598982:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936ea7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425dd1 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779384.598996:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7603be6c00/0xb1aa4014e936ea7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425dd1 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779384.599006:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6c00, rc 0) 00000100:00100000:1.0:1790779384.599166:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+12:18159:x1877767642830208:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 309us (5402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.599192:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 137 00000100:00100000:3.0:1790779384.606619:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779384.608249:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642830336 00000100:00100000:2.0:1790779384.608270:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642830336 00000100:00100000:2.0:1790779384.608367:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:2.0:1790779384.608379:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+12:18159:x1877767642830336:12345-192.168.203.3@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790779384.608426:0:22705:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790779384.608463:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790779384.608468:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790779384.608472:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790779384.608475:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1790779384.608478:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1790779384.612837:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+12:18159:x1877767642830336:12345-192.168.203.3@tcp:256:mount.lustre.0 Request processed in 4443us (6219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.612864:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 138 00000100:00100000:3.0:1790779384.616572:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779384.621327:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642830464 00000100:00100000:2.0:1790779384.621349:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642830464 00000100:00100000:2.0:1790779384.621448:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:2.0:1790779384.621461:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+12:18159:x1877767642830464:12345-192.168.203.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790779384.621484:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779384.621509:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7736fe8200/0xb1aa4014e936ea81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425dd8 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779384.621550:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7736fe8200/0xb1aa4014e936ea81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425dd8 expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779384.621564:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7736fe8200/0xb1aa4014e936ea81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425dd8 expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779384.621574:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe8200, rc 0) 00000100:00100000:2.0:1790779384.621692:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+13:18159:x1877767642830464:12345-192.168.203.3@tcp:101:mount.lustre.0 Request processed in 233us (5133us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.621702:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 139 00000100:00100000:3.0:1790779384.625507:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779384.625712:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642830592 00000100:00100000:2.0:1790779384.625726:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642830592 00000100:00100000:1.0:1790779384.626002:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:1.0:1790779384.626017:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+13:18159:x1877767642830592:12345-192.168.203.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790779384.626237:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+13:18159:x1877767642830592:12345-192.168.203.3@tcp:501:mount.lustre.0 Request processed in 223us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.626246:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 140 00000100:00100000:3.0:1790779384.629216:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779384.629335:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642830720 00000100:00100000:2.0:1790779384.629349:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642830720 00000100:00100000:2.0:1790779384.629421:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:2.0:1790779384.629432:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+13:18159:x1877767642830720:12345-192.168.203.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790779384.629637:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+13:18159:x1877767642830720:12345-192.168.203.3@tcp:503:mount.lustre.0 Request processed in 206us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.629647:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 141 00000100:00100000:3.0:1790779384.639247:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779384.640481:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642830848 00000100:00100000:1.0:1790779384.640499:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642830848 00000100:00100000:1.0:1790779384.640591:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:1.0:1790779384.640603:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+13:18172:x1877767642830848:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790779384.640844:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+13:18172:x1877767642830848:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 243us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.640854:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 142 00000100:00100000:3.0:1790779384.649984:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779384.650111:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642830976 00000100:00100000:2.0:1790779384.650126:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642830976 00000100:00100000:2.0:1790779384.650203:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:2.0:1790779384.650214:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+13:18172:x1877767642830976:12345-192.168.203.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790779384.650438:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+13:18172:x1877767642830976:12345-192.168.203.3@tcp:502:llog_process_th.0 Request processed in 225us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.650448:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 143 00000100:00100000:3.0:1790779384.657334:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779384.659025:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642831104 00000100:00100000:0.0:1790779384.659044:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642831104 00000100:00100000:0.0:1790779384.659116:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:0.0:1790779384.659126:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1877767642831104:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790779384.659165:0:25109:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0bc9b911-71a6-4cae-bee1-5750e3e7a595@192.168.203.3@tcp t0 exp 0000000000000000 cur 702 last 0 00000020:00000080:0.0:1790779384.659217:0:25109:0:(genops.c:1384:class_connect()) connect: client 0bc9b911-71a6-4cae-bee1-5750e3e7a595, cookie 0xb1aa4014e936ea88 00000004:00100000:0.0:1790779384.659248:0:25109:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790779384.659384:0:25109:0:(import.c:65:import_set_state_nolock()) ffff9b7726abc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790779384.659759:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:2397:x1877767642831104:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 632us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779384.659769:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1790779384.660073:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779384.660258:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779384.660298:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779384.660363:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642831744 00000100:00100000:1.0:1790779384.660371:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642831744 00000100:00100000:1.0:1790779384.660431:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:1.0:1790779384.660441:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2400:x1877767642831744:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779384.660494:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2400:x1877767642831744:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 56us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.660502:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:1.0:1790779384.663065:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779384.663110:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779384.663198:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642831872 00000100:00100000:3.0:1790779384.663209:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642831872 00000100:00100000:3.0:1790779384.663278:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1790779384.663290:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2400:x1877767642831872:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779384.663411:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2400:x1877767642831872:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 123us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.663420:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1790779384.664225:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642831360 00000100:00100000:2.0:1790779384.664234:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642831360 00000100:00100000:2.0:1790779384.664330:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642831616 00000100:00100000:2.0:1790779384.664334:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642831616 00000100:00100000:1.0:1790779384.664607:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642831488 00000100:00100000:1.0:1790779384.664613:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642831488 00000100:00100000:1.0:1790779384.664652:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:1.0:1790779384.664662:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:2400:x1877767642831360:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779384.664746:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:2400:x1877767642831360:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 86us (4674us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.664753:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:1.0:1790779384.664779:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:1.0:1790779384.664786:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2400:x1877767642831616:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779384.664812:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2400:x1877767642831616:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (4515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.664819:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:1.0:1790779384.664833:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1790779384.664838:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1877767642831488:12345-192.168.203.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790779384.664903:0:25109:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 0bc9b911-71a6-4cae-bee1-5750e3e7a595@192.168.203.3@tcp t0 exp 0000000000000000 cur 702 last 0 00000020:00000080:1.0:1790779384.664972:0:25109:0:(genops.c:1384:class_connect()) connect: client 0bc9b911-71a6-4cae-bee1-5750e3e7a595, cookie 0xb1aa4014e936ea8f 00000004:00100000:1.0:1790779384.665006:0:25109:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790779384.665131:0:25109:0:(import.c:65:import_set_state_nolock()) ffff9b76031a4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790779384.665164:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:2397:x1877767642831488:12345-192.168.203.3@tcp:38:mount.lustre.0 Request processed in 325us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.665171:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1790779384.668285:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779384.668331:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779384.669045:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642832128 00000100:00100000:1.0:1790779384.669059:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642832128 00000100:00100000:1.0:1790779384.669154:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642831232 00000100:00100000:1.0:1790779384.669158:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642831232 00000100:00100000:1.0:1790779384.669184:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1790779384.669195:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+7:18159:x1877767642832128:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790779384.669271:0:25109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790779384.669392:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+7:18159:x1877767642832128:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 193us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.669520:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1790779384.669544:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1790779384.669552:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:0:x1877767642831232:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790779384.669565:0:25109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790779384.669592:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:0:x1877767642831232:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 41us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.669599:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00080000:0.0:1790779384.669946:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790779384.675574:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779384.675634:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779384.675748:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642832000 00000100:00100000:2.0:1790779384.675762:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642832000 00000100:00100000:2.0:1790779384.675857:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642832256 00000100:00100000:2.0:1790779384.675861:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642832256 00000100:00100000:2.0:1790779384.675928:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1790779384.675967:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:0:x1877767642832000:12345-192.168.203.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790779384.676015:0:22711:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790779384.676105:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:0:x1877767642832000:12345-192.168.203.3@tcp:41:mount.lustre.0 Request processed in 141us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.676113:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1790779384.676135:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1790779384.676142:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:18159:x1877767642832256:12345-192.168.203.3@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790779384.676176:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:18159:x1877767642832256:12345-192.168.203.3@tcp:40:mount.lustre.0 Request processed in 35us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.676183:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00080000:1.0:1790779384.676626:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779384.680193:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779384.680254:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779384.680297:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779384.680431:0:22723:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642832640 00000100:00100000:3.0:1790779384.680444:0:22723:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642832640 00000100:00100000:3.0:1790779384.680519:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1790779384.680538:0:22722:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:18159:x1877767642832640:12345-192.168.203.3@tcp:900:mount.lustre.0 00000100:00100000:3.0:1790779384.680664:0:22722:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:18159:x1877767642832640:12345-192.168.203.3@tcp:900:mount.lustre.0 Request processed in 135us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.680673:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1790779384.681869:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642832384 00000100:00100000:0.0:1790779384.681897:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642832384 00000100:00100000:2.0:1790779384.682115:0:24218:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642832512 00000100:00100000:2.0:1790779384.682121:0:24218:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642832512 00000100:00100000:2.0:1790779384.682171:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:2.0:1790779384.682178:0:24218:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1877767642832512:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790779384.682221:0:24218:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0bc9b911-71a6-4cae-bee1-5750e3e7a595@192.168.203.3@tcp t0 exp 0000000000000000 cur 702 last 0 00000020:00000080:2.0:1790779384.682270:0:24218:0:(genops.c:1384:class_connect()) connect: client 0bc9b911-71a6-4cae-bee1-5750e3e7a595, cookie 0xb1aa4014e936ea96 00002000:00100000:2.0:1790779384.682287:0:24218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0bc9b911-71a6-4cae-bee1-5750e3e7a595/ffff9b7726b3a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790779384.682300:0:24218:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790779384.682571:0:24218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790779384.682615:0:24218:0:(import.c:65:import_set_state_nolock()) ffff9b7726b3f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790779384.682702:0:24218:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:2397:x1877767642832512:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 522us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.682712:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1790779384.684041:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1790779384.684054:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1877767642832384:12345-192.168.203.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790779384.684091:0:24695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0bc9b911-71a6-4cae-bee1-5750e3e7a595@192.168.203.3@tcp t0 exp 0000000000000000 cur 702 last 0 00000020:00000080:1.0:1790779384.684132:0:24695:0:(genops.c:1384:class_connect()) connect: client 0bc9b911-71a6-4cae-bee1-5750e3e7a595, cookie 0xb1aa4014e936ea9d 00002000:00100000:1.0:1790779384.684147:0:24695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0bc9b911-71a6-4cae-bee1-5750e3e7a595/ffff9b76031a5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790779384.684158:0:24695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790779384.684250:0:24695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790779384.684284:0:24695:0:(import.c:65:import_set_state_nolock()) ffff9b76031a4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790779384.684406:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:2397:x1877767642832384:12345-192.168.203.3@tcp:8:mount.lustre.0 Request processed in 352us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.684415:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:1.0:1790779384.694166:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779384.694706:0:22715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642832768 00000100:00100000:0.0:1790779384.694719:0:22715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642832768 00000100:00100000:0.0:1790779384.694784:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:0.0:1790779384.694795:0:22715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:18159:x1877767642832768:12345-192.168.203.3@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790779384.695194:0:22715:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790779384.695658:0:22715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:18159:x1877767642832768:12345-192.168.203.3@tcp:33:mount.lustre.0 Request processed in 862us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779384.695668:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:0.0:1790779384.832247:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779384.832358:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642832896 00000100:00100000:2.0:1790779384.832396:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642832896 00000100:00100000:2.0:1790779384.832522:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:2.0:1790779384.832534:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:18195:x1877767642832896:12345-192.168.203.3@tcp:101:mkdir.0 00010000:00010000:2.0:1790779384.832867:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779384.832952:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9c00/0xb1aa4014e936eaa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e09 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779384.833040:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779384.833057:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779384.833071:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779384.833129:0:22711:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790779384.833134:0:22711:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779384.833158:0:22711:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779384.833189:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9c00/0xb1aa4014e936eaa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e09 expref: 8 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779384.833209:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e09 expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779384.833456:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617e00) 00010000:00010000:2.0:1790779384.833459:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779384.833463:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe9a00, rc 0) 00000100:00100000:2.0:1790779384.833677:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+7:18195:x1877767642832896:12345-192.168.203.3@tcp:101:mkdir.0 Request processed in 1144us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.833687:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 22 00000100:00100000:3.0:1790779384.936412:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663908352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779384.936521:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779384.936625:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663908352 00000100:00100000:3.0:1790779384.936635:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663908352 00000100:00100000:3.0:1790779384.936703:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790779384.936713:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663908352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790779384.936743:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1790779384.936752:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779384.936806:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663908352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.936815:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790779384.936923:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1790779384.936974:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663908352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779384.939766:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663908480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779384.939872:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779384.939984:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663908480 00000100:00100000:2.0:1790779384.939994:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663908480 00000100:00100000:2.0:1790779384.940050:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790779384.940060:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663908480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790779384.940126:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790779384.940181:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663908480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.940189:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790779384.940239:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663908480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779384.940421:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9d73c52-009d-4820-b396-7792bc096088:3652:1877767663908608:0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.940459:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779384.940497:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663909120:0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.940529:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779384.940555:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663909632:0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.940584:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779384.940606:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790779384.940614:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663908992:0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.940639:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779384.940658:0:24216:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663909120 00000100:00100000:1.0:1790779384.940665:0:24216:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663909120 00000100:00100000:1.0:1790779384.940711:0:24216:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663908992 00000100:00100000:1.0:1790779384.940715:0:24216:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663908992 00000100:00100000:1.0:1790779384.940742:0:24216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790779384.940751:0:24216:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663909120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779384.940759:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663909632 00000100:00100000:3.0:1790779384.940766:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663909632 00000100:00100000:1.0:1790779384.940799:0:24216:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663909120:12345-0@lo:400:kworker.0 Request processed in 50us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.940807:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790779384.940809:0:24216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790779384.940820:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663909632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779384.940832:0:24216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790779384.944197:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663909504:0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.944318:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779384.944437:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663909120:0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.944456:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663909632:0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.944482:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790779384.944507:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663910016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790779384.944537:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779384.944589:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663908736:0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.944615:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779384.944702:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663909632:12345-0@lo:400:kworker.0 Request processed in 46us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.944717:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790779384.944755:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663909504 00000100:00100000:3.0:1790779384.944762:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663909504 00000100:00100000:3.0:1790779384.944816:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790779384.944827:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663909504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779384.944911:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1877767663909504:12345-0@lo:400:kworker.0 Request processed in 85us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.944928:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790779384.944964:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663910016 00000100:00100000:3.0:1790779384.944968:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663910016 00000100:00100000:3.0:1790779384.944996:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790779384.945003:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663910016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790779384.945023:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790779384.945059:0:24216:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663908992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779384.945061:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663910016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.945111:0:24216:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663908992:12345-0@lo:400:kworker.0 Request processed in 4271us (4470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.945119:0:24216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790779384.945247:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790779384.945307:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663910016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779384.945320:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663908992:0@lo:400:kworker.0 00010000:00080000:3.0:1790779384.945333:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cce00 x1877767663909504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779384.945343:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1877767663909504:0@lo:400:kworker.0 00000100:00080000:3.0:1790779384.945429:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790779384.945435:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790779384.945438:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790779384.945441:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790779384.945588:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663908864:0@lo:400:kworker.0 00000100:00100000:3.0:1790779384.945630:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779384.945655:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663909376:0@lo:400:kworker.0 00000100:00100000:3.0:1790779384.945678:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779384.945696:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663909888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779384.945719:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779384.945761:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663909888 00000100:00100000:3.0:1790779384.945766:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663909888 00000100:00100000:3.0:1790779384.945792:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790779384.945799:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663909888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779384.945814:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790779384.945847:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663909888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.945853:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790779384.945909:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663909888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779384.945943:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663908864 00000100:00100000:3.0:1790779384.945947:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663908864 00000100:00100000:3.0:1790779384.945970:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663909376 00000100:00100000:3.0:1790779384.945974:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663909376 00000100:00100000:3.0:1790779384.945998:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790779384.946005:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663908864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779384.946040:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1877767663908864:12345-0@lo:400:kworker.0 Request processed in 36us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.946047:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790779384.946060:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790779384.946065:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663909376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779384.946190:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663909376:12345-0@lo:400:kworker.0 Request processed in 124us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.946198:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1790779384.946219:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779384.946237:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1877767663908864:0@lo:400:kworker.0 00000100:00100000:3.0:1790779384.946247:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663909376:0@lo:400:kworker.0 00000100:00100000:3.0:1790779384.946291:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663908608 00000100:00100000:3.0:1790779384.946297:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663908608 00000100:00100000:3.0:1790779384.946344:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790779384.946355:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+24:3652:x1877767663908608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779384.946400:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+24:3652:x1877767663908608:12345-0@lo:400:kworker.0 Request processed in 49us (5940us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779384.946407:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790779384.946444:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9d73c52-009d-4820-b396-7792bc096088:3652:1877767663908608:0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.946830:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663909248:0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.946873:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779384.946913:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663909760:0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.946950:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779384.946983:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663909248 00000100:00100000:2.0:1790779384.946988:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663909248 00000100:00100000:2.0:1790779384.947015:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663909760 00000100:00100000:2.0:1790779384.947018:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663909760 00000100:00100000:2.0:1790779384.947051:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790779384.947058:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663909248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.947107:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1877767663909248:12345-0@lo:400:kworker.0 Request processed in 50us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.947113:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790779384.947125:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790779384.947130:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663909760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779384.947152:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1877767663909760:12345-0@lo:400:kworker.0 Request processed in 23us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779384.947157:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1790779384.947184:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790779384.947206:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1877767663909248:0@lo:400:kworker.0 00010000:00080000:2.0:1790779384.947218:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cca80 x1877767663909760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779384.947229:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1877767663909760:0@lo:400:kworker.0 00000100:00100000:0.0:1790779384.950486:0:24217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663908736 00000100:00100000:0.0:1790779384.950504:0:24217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663908736 00000100:00100000:1.0:1790779384.950692:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790779384.950709:0:24217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663908736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779384.950858:0:24217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663908736:12345-0@lo:400:kworker.0 Request processed in 152us (6240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779384.950868:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790779384.950972:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b760300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663908736:0@lo:400:kworker.0 00010000:00010000:3.0:1790779385.195177:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790779385.648035:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779386.220496:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779387.250500:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790779387.588677:0:25591:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1790779388.010137:0:23444:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0bc9b911-71a6-4cae-bee1-5750e3e7a595 00000001:00100000:1.0:1790779388.010162:0:23444:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5 00000001:00100000:3.0:1790779388.010474:0:25031:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0bc9b911-71a6-4cae-bee1-5750e3e7a595 00000001:00100000:3.0:1790779388.010482:0:25031:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5 00000001:00100000:1.0:1790779388.010582:0:24212:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0bc9b911-71a6-4cae-bee1-5750e3e7a595 00000001:00100000:1.0:1790779388.010596:0:24212:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5 00000001:00100000:1.0:1790779388.010728:0:22691:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0bc9b911-71a6-4cae-bee1-5750e3e7a595 00000001:00100000:1.0:1790779388.010734:0:22691:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35f7145f-59d1-42cd-8cb7-4feb7ca20cb5 00010000:00010000:3.0:1790779388.264158:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779388.520423:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663910144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790779388.520497:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779388.521646:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663910144 00000100:00100000:3.0:1790779388.521657:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663910144 00000100:00100000:3.0:1790779388.521726:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790779388.521735:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663910144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790779388.521765:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790779388.521831:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663910144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779388.521838:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790779388.521920:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663910144:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1790779388.522033:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790779389.289895:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779389.545334:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663910272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779389.545413:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779389.545586:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663910272 00000100:00100000:2.0:1790779389.545596:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663910272 00000100:00100000:2.0:1790779389.545645:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790779389.545655:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663910272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790779389.545687:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790779389.545735:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663910272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779389.545742:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790779389.545842:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663910272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790779390.056053:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663910528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790779390.056093:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663910656:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.057466:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779390.057533:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663911168:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.057565:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779390.057600:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663911680:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.057626:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779390.057657:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663912192:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.057687:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779390.057713:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1790779390.057719:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663910784:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.057741:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779390.057759:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663911296:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.057779:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779390.057796:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663911808:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.057818:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779390.057834:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b76046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663912320:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.057852:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779390.057908:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663911168 00000100:00100000:2.0:1790779390.057916:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663911168 00000100:00100000:2.0:1790779390.057949:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663912192 00000100:00100000:2.0:1790779390.057952:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663912192 00000100:00100000:2.0:1790779390.057974:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663911808 00000100:00100000:2.0:1790779390.057977:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663911808 00000100:00100000:2.0:1790779390.057987:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663912320 00000100:00100000:2.0:1790779390.057990:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663912320 00000100:00100000:2.0:1790779390.058005:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790779390.058012:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663911168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058065:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1877767663911168:12345-0@lo:400:kworker.0 Request processed in 52us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.058072:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790779390.058089:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790779390.058097:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663912192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058124:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1877767663912192:12345-0@lo:400:kworker.0 Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.058139:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790779390.058152:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790779390.058157:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663911808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058185:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1877767663911808:12345-0@lo:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.058191:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790779390.058202:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790779390.058208:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663912320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058234:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1877767663912320:12345-0@lo:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.058239:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790779390.058262:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663911680 00000100:00100000:2.0:1790779390.058265:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663911680 00000100:00100000:2.0:1790779390.058287:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663910784 00000100:00100000:2.0:1790779390.058290:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663910784 00000100:00100000:2.0:1790779390.058308:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790779390.058315:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663911680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058343:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663911680:12345-0@lo:400:kworker.0 Request processed in 29us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.058349:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790779390.058360:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779390.058366:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663910784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058394:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663910784:12345-0@lo:400:kworker.0 Request processed in 28us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.058399:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779390.058422:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663910656 00000100:00100000:2.0:1790779390.058426:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663910656 00000100:00100000:2.0:1790779390.058442:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663911296 00000100:00100000:2.0:1790779390.058445:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663911296 00000100:00100000:2.0:1790779390.058456:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790779390.058462:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663910656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058497:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1877767663910656:12345-0@lo:400:kworker.0 Request processed in 35us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.058502:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790779390.058513:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790779390.058519:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663911296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058546:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663911296:12345-0@lo:400:kworker.0 Request processed in 27us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.058552:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1790779390.058573:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790779390.058577:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790779390.058579:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790779390.058581:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779390.058613:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663910784:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058624:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663911296:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058632:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1877767663911808:0@lo:400:kworker.0 00010000:00080000:2.0:1790779390.058643:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b76046cca80 x1877767663912320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790779390.058653:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b76046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1877767663912320:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058663:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1877767663910656:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058683:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1877767663911168:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058692:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663911680:0@lo:400:kworker.0 00000100:00100000:2.0:1790779390.058700:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1877767663912192:0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.058931:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779390.058959:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663910400:0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.058989:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779390.059059:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663910528 00000100:00100000:0.0:1790779390.059063:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663910528 00000100:00100000:0.0:1790779390.059085:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790779390.059091:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663910528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790779390.059112:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790779390.059152:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663910528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779390.059157:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790779390.059158:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663910400 00000100:00100000:1.0:1790779390.059162:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663910400 00000100:00100000:1.0:1790779390.059190:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790779390.059196:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:3650:x1877767663910400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779390.059230:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+24:3650:x1877767663910400:12345-0@lo:400:kworker.0 Request processed in 34us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779390.059236:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790779390.059322:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663910400:0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.059329:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663911040:0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.059353:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779390.059373:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663911552:0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.059393:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779390.059416:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663912064:0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.059437:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779390.059461:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663910528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779390.059473:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1790779390.059479:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663910912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779390.059501:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779390.059516:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663911424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779390.059532:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779390.059547:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663911936:0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.059566:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779390.059579:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773f51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663912448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790779390.059610:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779390.059824:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663911040 00000100:00100000:3.0:1790779390.059828:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663911040 00000100:00100000:2.0:1790779390.059842:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663912064 00000100:00100000:2.0:1790779390.059845:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663912064 00000100:00100000:3.0:1790779390.060061:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663911552 00000100:00100000:3.0:1790779390.060066:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663911552 00000100:00080000:1.0:1790779390.066938:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790779390.066951:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790779390.066954:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779390.067012:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663911936 00000100:00100000:2.0:1790779390.067022:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663911936 00000100:00100000:1.0:1790779390.067043:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790779390.067059:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663912064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790779390.067150:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1877767663912064:12345-0@lo:400:kworker.0 Request processed in 94us (7711us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779390.067202:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790779390.067210:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663911040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.067321:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663911040:12345-0@lo:400:kworker.0 Request processed in 111us (7966us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779390.067329:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790779390.067347:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790779390.067353:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663911552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.067381:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663911552:12345-0@lo:400:kworker.0 Request processed in 29us (7987us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779390.067387:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790779390.067412:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663910912 00000100:00100000:3.0:1790779390.067415:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663910912 00000100:00100000:3.0:1790779390.067432:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663911424 00000100:00100000:3.0:1790779390.067435:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663911424 00000100:00100000:3.0:1790779390.067445:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663912448 00000100:00100000:3.0:1790779390.067448:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663912448 00000100:00100000:3.0:1790779390.067459:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790779390.067465:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663910912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779390.067486:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790779390.067519:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1877767663910912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (8017us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779390.067525:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790779390.067537:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790779390.067543:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663911424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790779390.067558:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790779390.067581:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663911424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (8047us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779390.067706:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790779390.067713:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790779390.067717:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790779390.067721:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663912448:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790779390.067721:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663911936:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1790779390.067731:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790779390.067753:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1877767663912448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (8142us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.067753:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1877767663911936:12345-0@lo:400:kworker.0 Request processed in 34us (8186us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779390.067759:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790779390.067759:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1790779390.067783:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779390.067820:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663910912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779390.067834:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663911424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779390.067843:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1877767663911936:0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.067854:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773f51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663912448:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1790779390.067866:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c50000 x1877767663912064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779390.067876:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1877767663912064:0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.067927:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663911040:0@lo:400:kworker.0 00000100:00100000:3.0:1790779390.067936:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1877767663911552:0@lo:400:kworker.0 00000100:00100000:1.0:1790779390.068028:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790779390.132060:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779390.132100:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779390.132120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779390.132137:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779390.132153:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779390.132167:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779390.132181:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779390.132195:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779390.132230:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779390.132258:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642833280 00000100:00100000:2.0:1790779390.132268:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642833280 00000100:00100000:2.0:1790779390.132316:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642833792 00000100:00100000:2.0:1790779390.132320:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642833792 00000100:00100000:2.0:1790779390.132333:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642833152 00000100:00100000:2.0:1790779390.132335:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642833152 00000100:00100000:2.0:1790779390.132358:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642833664 00000100:00100000:2.0:1790779390.132361:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642833664 00000100:00100000:2.0:1790779390.132376:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:2.0:1790779390.132384:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2398:x1877767642833280:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779390.132470:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2398:x1877767642833280:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 85us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.132477:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:2.0:1790779390.132495:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:2.0:1790779390.132501:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2398:x1877767642833792:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779390.132527:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2398:x1877767642833792:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.132533:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:2.0:1790779390.132543:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:2.0:1790779390.132549:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2398:x1877767642833152:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779390.132569:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2398:x1877767642833152:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.132574:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:2.0:1790779390.132584:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:2.0:1790779390.132590:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:2398:x1877767642833664:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779390.132614:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:2398:x1877767642833664:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.132619:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:2.0:1790779390.132637:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642833536 00000100:00100000:2.0:1790779390.132640:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642833536 00000100:00100000:2.0:1790779390.132664:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642834048 00000100:00100000:2.0:1790779390.132673:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642834048 00000100:00100000:2.0:1790779390.132688:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642833408 00000100:00100000:2.0:1790779390.132690:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642833408 00000100:00100000:2.0:1790779390.132703:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642833920 00000100:00100000:2.0:1790779390.132705:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642833920 00000100:00100000:2.0:1790779390.132717:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:2.0:1790779390.132723:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2398:x1877767642833536:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779390.132764:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2398:x1877767642833536:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 41us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.132770:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:2.0:1790779390.132782:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1790779390.132788:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2398:x1877767642834048:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779390.132808:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2398:x1877767642834048:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.132814:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1790779390.132823:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:2.0:1790779390.132829:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2398:x1877767642833408:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779390.132851:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2398:x1877767642833408:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 23us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.132857:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:2.0:1790779390.132867:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:2.0:1790779390.132873:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2398:x1877767642833920:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779390.133204:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2398:x1877767642833920:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 330us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779390.133210:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00080000:2.0:1790779390.133245:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790779390.133250:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790779390.133252:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790779390.133254:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790779390.133436:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642833024 00000100:00100000:3.0:1790779390.133441:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642833024 00000100:00100000:3.0:1790779390.133469:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 146 00000100:00100000:3.0:1790779390.133475:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+13:2398:x1877767642833024:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779390.133502:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+13:2398:x1877767642833024:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 27us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779390.133513:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 146 00010000:00010000:2.0:1790779390.313858:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790779391.202905:0:25739:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcae940000 20000000:00000080:1.0:1790779391.202924:0:25739:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b773e38d000 uarg=0000000000000000 20000000:01000000:1.0:1790779391.202967:0:25739:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790779391.202973:0:25739:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1790779391.202977:0:25739:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790779391.208184:0:25740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1790779391.216038:0:25739:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790779391.226584:0:25739:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790779391.226615:0:25739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.226942:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7602670800/0xb1aa4014e936e70f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e708 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.226951:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e71d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e716 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.226956:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936e75c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e755 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.226961:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e7f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936e7ef expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.226970:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ea42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d68 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.226976:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b7736fe8200/0xb1aa4014e936ea81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425dd8 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.226983:0:25739:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227027:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7736fe8200/0xb1aa4014e936ea81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425dd8 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227056:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7736fe8200/0xb1aa4014e936ea81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425dd8 expref: 12 pid: 22704 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779391.227070:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663912576:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779391.227163:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ea42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d68 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227172:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ea42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d68 expref: 12 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779391.227181:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663912704:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779391.227211:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e7f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e7ef expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227219:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e7f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e7ef expref: 23 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779391.227228:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663912832:0@lo:104: 00000100:00100000:2.0:1790779391.227266:0:25739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790779391.227302:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936e75c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e755 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227310:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936e75c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e755 expref: 23 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779391.227318:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663912960:0@lo:104: 00000100:00100000:2.0:1790779391.227336:0:25739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779391.227373:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663912832 00000100:00100000:2.0:1790779391.227380:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663912832 00000100:00100000:2.0:1790779391.227414:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663912960 00000100:00100000:2.0:1790779391.227416:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663912960 00000100:00100000:2.0:1790779391.227428:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790779391.227435:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+4:25739:x1877767663912832:12345-0@lo:104: 00010000:00010000:2.0:1790779391.227447:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227488:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790779391.227494:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+4:25739:x1877767663912832:12345-0@lo:104: Request processed in 59us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779391.227500:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790779391.227517:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790779391.227523:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+3:25739:x1877767663912960:12345-0@lo:104: 00010000:00010000:2.0:1790779391.227531:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227561:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790779391.227565:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+3:25739:x1877767663912960:12345-0@lo:104: Request processed in 43us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779391.227571:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1790779391.227588:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790779391.227593:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227600:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6e00 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779391.227604:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227623:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779391.227693:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779391.227700:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779391.227726:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227732:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779391.227748:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227754:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be6e00/0xb1aa4014e936e7ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e7f6 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227836:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779391.227839:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227846:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76034af200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779391.227848:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227957:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779391.227964:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779391.227974:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779391.227988:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.227994:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779391.228007:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228014:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b76034af200/0xb1aa4014e936e755 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e75c expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228023:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779391.228024:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779391.228026:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779391.228038:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663913216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779391.228068:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779391.228103:0:22696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663913216 00000100:00100000:2.0:1790779391.228107:0:22696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663913216 00010000:00010000:2.0:1790779391.228137:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936e75c lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e755 expref: 24 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779391.228156:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790779391.228162:0:22696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+24:3651:x1877767663913216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779391.228171:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779391.228175:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936e75c lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e755 expref: 24 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228184:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936e75c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e755 expref: 24 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228204:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779391.228230:0:22696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+24:3651:x1877767663913216:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779391.228236:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790779391.228268:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e9d73c52-009d-4820-b396-7792bc096088:3651:1877767663913216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779391.228300:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e716 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228309:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e71d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e716 expref: 23 pid: 22704 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779391.228317:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663913344:0@lo:104: 00000100:00100000:2.0:1790779391.228339:0:25739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779391.228358:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663913344 00000100:00100000:2.0:1790779391.228362:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663913344 00000100:00100000:2.0:1790779391.228378:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790779391.228383:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+3:25739:x1877767663913344:12345-0@lo:104: 00010000:00010000:2.0:1790779391.228391:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228417:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790779391.228421:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+3:25739:x1877767663913344:12345-0@lo:104: Request processed in 38us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779391.228426:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1790779391.228439:0:25050:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779391.228443:0:25050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228460:0:25050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6400 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779391.228462:0:25050:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228469:0:25050:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779391.228474:0:25050:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779391.228479:0:25050:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779391.228492:0:25050:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228498:0:25050:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779391.228509:0:25050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228516:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936e716 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e71d expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228526:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779391.228528:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779391.228529:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779391.228537:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9d73c52-009d-4820-b396-7792bc096088:3652:1877767663913472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779391.228562:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790779391.228599:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b7602670800/0xb1aa4014e936e70f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1aa4014e936e708 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228615:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b7602670800/0xb1aa4014e936e70f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1aa4014e936e708 expref: 23 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779391.228623:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663913600:0@lo:104: 00000100:00100000:2.0:1790779391.228714:0:25739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779391.228733:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663913600 00000100:00100000:2.0:1790779391.228738:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663913600 00000100:00100000:2.0:1790779391.228754:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790779391.228832:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+3:25739:x1877767663913600:12345-0@lo:104: 00010000:00010000:2.0:1790779391.228840:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.228966:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790779391.228971:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e9d73c52-009d-4820-b396-7792bc096088+3:25739:x1877767663913600:12345-0@lo:104: Request processed in 142us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779391.228977:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1790779391.228993:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790779391.228998:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.229004:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b770894b200 already unused, calling callback (ffffffffc1244c20) 10000000:00010000:2.0:1790779391.229007:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.229014:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790779391.229021:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779391.229033:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790779391.229051:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.229057:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790779391.229065:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.229072:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.103@tcp lock: ffff9b770894b200/0xb1aa4014e936e708 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1aa4014e936e70f expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.229086:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779391.229087:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779391.229088:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779391.229099:0:25739:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77342c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1790779391.229115:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663912832:0@lo:104: 00010000:00010000:2.0:1790779391.229127:0:25739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894ae00/0xb1aa4014e936e75c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e755 expref: 23 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779391.229131:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790779391.229138:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663912960:0@lo:104: 00000100:00100000:2.0:1790779391.229149:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663913344:0@lo:104: 00000100:00100000:3.0:1790779391.229155:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663913088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779391.229159:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663913600:0@lo:104: 00000100:00100000:3.0:1790779391.229189:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779391.229213:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790779391.229218:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663913728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790779391.229238:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779391.229262:0:22698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663913472 00000100:00100000:3.0:1790779391.229269:0:22698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663913472 00010000:00010000:3.0:1790779391.229285:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e71d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e716 expref: 23 pid: 22704 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779391.229296:0:22696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663913088 00000100:00100000:3.0:1790779391.229302:0:22698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663913728 00000100:00100000:2.0:1790779391.229302:0:22696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663913088 00000100:00100000:3.0:1790779391.229308:0:22698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663913728 00010000:00010000:2.0:1790779391.229321:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e7f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e7ef expref: 25 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779391.229324:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7602670800/0xb1aa4014e936e70f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e708 expref: 25 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779391.229352:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790779391.229366:0:22696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+25:3652:x1877767663913472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790779391.229376:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779391.229381:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e71d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e716 expref: 25 pid: 22704 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.229390:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e716 expref: 25 pid: 22704 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.229401:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894ac00/0xb1aa4014e936e71d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e716 expref: 25 pid: 22704 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.229411:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779391.229440:0:22696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9d73c52-009d-4820-b396-7792bc096088+24:3652:x1877767663913472:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779391.232721:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779391.232745:0:22698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9d73c52-009d-4820-b396-7792bc096088+24:3650:x1877767663913088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779391.232765:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779391.232775:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e7f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e7ef expref: 24 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779391.232789:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e7f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e7ef expref: 24 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779391.232807:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b770894b400/0xb1aa4014e936e7f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e7ef expref: 24 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779391.232838:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779391.233639:0:22698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9d73c52-009d-4820-b396-7792bc096088+23:3650:x1877767663913088:12345-0@lo:103:ldlm_bl.0 Request processed in 903us (4446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779391.233648:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790779391.233681:0:22698:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790779391.233688:0:22698:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1790779391.233903:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790779391.233913:0:22698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9d73c52-009d-4820-b396-7792bc096088+22:3650:x1877767663913728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790779391.233924:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779391.233930:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7602670800/0xb1aa4014e936e70f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1aa4014e936e708 expref: 22 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779391.233939:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7602670800/0xb1aa4014e936e70f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1aa4014e936e708 expref: 22 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779391.233950:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7602670800/0xb1aa4014e936e70f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1aa4014e936e708 expref: 22 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779391.233960:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779391.233986:0:22698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9d73c52-009d-4820-b396-7792bc096088+21:3650:x1877767663913728:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (4748us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779391.233992:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790779391.234207:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790779391.234255:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9d73c52-009d-4820-b396-7792bc096088:3652:1877767663913472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779391.234518:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663913728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790779391.234527:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e9d73c52-009d-4820-b396-7792bc096088:3650:1877767663913088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790779391.237194:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779391.237286:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779391.238048:0:22697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642834304 00000100:00100000:0.0:1790779391.238058:0:22697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642834304 00010000:00010000:0.0:1790779391.238098:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ea42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d68 expref: 13 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779391.238130:0:22697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642834176 00000100:00100000:0.0:1790779391.238134:0:22697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642834176 00010000:00010000:0.0:1790779391.238147:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b7736fe8200/0xb1aa4014e936ea81 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425dd8 expref: 14 pid: 22704 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779391.238172:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1790779391.238197:0:22697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760316d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:665a1626-0317-4a55-b618-c653e5716dd5+14:2401:x1877767642834304:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779391.238212:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779391.238218:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ea42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d68 expref: 14 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238229:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ea42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d68 expref: 14 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238249:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779391.238304:0:22697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760316d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:665a1626-0317-4a55-b618-c653e5716dd5+14:2401:x1877767642834304:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 108us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779391.238312:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:0.0:1790779391.238360:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:0.0:1790779391.238367:0:22697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:665a1626-0317-4a55-b618-c653e5716dd5+13:2401:x1877767642834176:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779391.238375:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779391.238379:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b7736fe8200/0xb1aa4014e936ea81 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425dd8 expref: 13 pid: 22704 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238389:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b7736fe8200/0xb1aa4014e936ea81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425dd8 expref: 13 pid: 22704 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238403:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238411:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238427:0:22697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238446:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238453:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238461:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238467:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe9c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779391.238472:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238481:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238490:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779391.238499:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790779391.238520:0:22697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:665a1626-0317-4a55-b618-c653e5716dd5+13:2401:x1877767642834176:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 152us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779391.238527:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00010000:00010000:1.0:1790779391.240012:0:25739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7736fe8200/0xb1aa4014e936ea81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425dd8 expref: 12 pid: 22704 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779391.240033:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663912576:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779391.240091:0:25739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7718769200/0xb1aa4014e936ea42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d68 expref: 11 pid: 22703 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779391.240101:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1877767663912704:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779391.240137:0:25739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779391.240147:0:25739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779391.240153:0:25739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779391.240160:0:25739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b7736fe9c00/0xb1aa4014e936eab2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779391.344309:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790779392.360414:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779392.509325:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779392.509606:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642834432 00000100:00100000:0.0:1790779392.509621:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642834432 00000100:00100000:0.0:1790779392.509700:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:0.0:1790779392.509711:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+11:18043:x1877767642834432:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779392.509734:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779392.509777:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768600/0xb1aa4014e936eab9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e10 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779392.509825:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768600/0xb1aa4014e936eab9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e10 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779392.509839:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768600/0xb1aa4014e936eab9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e10 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779392.509857:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768600, rc 0) 00000100:00100000:0.0:1790779392.510074:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+12:18043:x1877767642834432:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 363us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779392.510083:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 147 00000100:00100000:0.0:1790779392.519725:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779392.526186:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642834560 00000100:00100000:1.0:1790779392.526209:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642834560 00000100:00100000:1.0:1790779392.527099:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:1.0:1790779392.527119:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+12:18043:x1877767642834560:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779392.527340:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+12:18043:x1877767642834560:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 227us (7628us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779392.527349:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 148 00000100:00100000:1.0:1790779392.536501:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779392.536615:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642834688 00000100:00100000:2.0:1790779392.536629:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642834688 00000100:00100000:2.0:1790779392.536700:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:2.0:1790779392.536712:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+12:18043:x1877767642834688:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790779392.536977:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:665a1626-0317-4a55-b618-c653e5716dd5+12:18043:x1877767642834688:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 266us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779392.536986:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 149 00000100:00100000:3.0:1790779392.553417:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779392.555757:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642834816 00000100:00100000:0.0:1790779392.555779:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642834816 00000100:00100000:0.0:1790779392.555873:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:0.0:1790779392.555912:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+12:18043:x1877767642834816:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779392.555945:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779392.555973:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7718768800/0xb1aa4014e936eac0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e17 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779392.556010:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7718768800/0xb1aa4014e936eac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e17 expref: 13 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779392.556037:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7718768800/0xb1aa4014e936eac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e17 expref: 13 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779392.556047:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768800, rc 0) 00000100:00100000:0.0:1790779392.556162:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+13:18043:x1877767642834816:12345-192.168.203.3@tcp:101:ll_cfg_requeue.0 Request processed in 254us (2759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779392.556242:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 150 00000100:00100000:0.0:1790779392.561332:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779392.561503:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642834944 00000100:00100000:1.0:1790779392.561517:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642834944 00000100:00100000:1.0:1790779392.561593:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:1.0:1790779392.561605:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+13:18043:x1877767642834944:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779392.561843:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+13:18043:x1877767642834944:12345-192.168.203.3@tcp:501:ll_cfg_requeue.0 Request processed in 239us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779392.561853:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 151 00000100:00100000:1.0:1790779392.571683:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779392.581384:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642835072 00000100:00100000:0.0:1790779392.581403:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642835072 00000100:00100000:2.0:1790779392.587556:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 152 00000100:00100000:2.0:1790779392.587572:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b77106bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+13:18043:x1877767642835072:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790779392.587734:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b77106bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:665a1626-0317-4a55-b618-c653e5716dd5+13:18043:x1877767642835072:12345-192.168.203.3@tcp:503:ll_cfg_requeue.0 Request processed in 166us (16064us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779392.587746:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 152 00000040:00080000:3.0:1790779392.744688:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790779393.003559:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.004042:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642835200 00000100:00100000:2.0:1790779393.004054:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642835200 00000100:00100000:2.0:1790779393.004135:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1790779393.004146:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:18666:x1877767642835200:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779393.004167:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779393.004188:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eac7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e1e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004254:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eace lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004269:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eace lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004284:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eace lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004296:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936ead5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004303:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936ead5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004308:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936ead5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004399:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8000/0xb1aa4014e936eadc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004406:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8000/0xb1aa4014e936eadc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004413:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8000/0xb1aa4014e936eadc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.004440:0:22713:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790779393.004444:0:22713:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779393.004479:0:22713:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8000/0xb1aa4014e936eadc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004489:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eace lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004494:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eace lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004500:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eace lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004506:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe8600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779393.004510:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eace lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004517:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eace lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004527:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617e00) 00010000:00010000:2.0:1790779393.004536:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779393.004542:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eace lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004548:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eace lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004563:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936ead5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004568:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936ead5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004574:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936ead5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004578:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe9000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779393.004581:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936ead5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004586:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936ead5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004593:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b7603617d00) 00010000:00010000:2.0:1790779393.004596:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779393.004598:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936ead5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004604:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936ead5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004635:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e1e expref: 8 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004658:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8000/0xb1aa4014e936eadc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e1e expref: 7 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.004665:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b7603617700) 00010000:00010000:2.0:1790779393.004668:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779393.004671:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe8000, rc 0) 00000100:00100000:2.0:1790779393.004872:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:18666:x1877767642835200:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 727us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779393.004939:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00080000:3.0:1790779393.005000:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790779393.014517:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779393.014592:0:22723:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642835328 00000100:00100000:3.0:1790779393.014613:0:22723:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642835328 00000100:00100000:3.0:1790779393.014668:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1790779393.014677:0:22723:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:18666:x1877767642835328:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790779393.014767:0:22723:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:18666:x1877767642835328:12345-192.168.203.3@tcp:900:lhsmtool_posix.0 Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.014775:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:0.0:1790779393.020549:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.020632:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642835584 00000100:00100000:2.0:1790779393.020641:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642835584 00000100:00100000:2.0:1790779393.020698:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:2.0:1790779393.020717:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:18666:x1877767642835584:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779393.020738:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779393.020757:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eae3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e25 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.020825:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eaea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.020840:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eaea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.020862:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eaea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.020921:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eaf1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.020939:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eaf1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.020947:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eaf1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021045:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9c00/0xb1aa4014e936eaf8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021053:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9c00/0xb1aa4014e936eaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021059:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9c00/0xb1aa4014e936eaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.021068:0:22711:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1790779393.021196:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eaea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021203:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eaea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021209:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eaea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021214:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe9000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779393.021218:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eaea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021225:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eaea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021244:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b7603617700) 00010000:00010000:2.0:1790779393.021247:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779393.021251:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eaea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021257:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eaea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021270:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eaf1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021277:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eaf1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021283:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eaf1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021288:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe8600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779393.021291:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eaf1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021296:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eaf1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021303:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b7603617d00) 00010000:00010000:2.0:1790779393.021305:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779393.021308:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eaf1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.021314:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eaf1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.023168:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eae3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e25 expref: 10 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.023191:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9c00/0xb1aa4014e936eaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e25 expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.023200:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603617500) 00010000:00010000:2.0:1790779393.023202:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779393.023205:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe9c00, rc 0) 00000100:00100000:2.0:1790779393.023292:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+9:18666:x1877767642835584:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 2585us (2751us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1790779393.023301:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1790779393.036393:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779393.036470:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642835712 00000100:00100000:1.0:1790779393.036480:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642835712 00000100:00100000:1.0:1790779393.036541:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:1.0:1790779393.036560:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+9:18666:x1877767642835712:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790779393.036671:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+9:18666:x1877767642835712:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 122us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779393.036679:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:0.0:1790779393.040745:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.040844:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642835840 00000100:00100000:2.0:1790779393.040854:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642835840 00000100:00100000:2.0:1790779393.040961:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:2.0:1790779393.040973:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:18666:x1877767642835840:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1790779393.041092:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1790779393.044935:0:25109:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3919us 00000100:00100000:2.0:1790779393.064046:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:18666:x1877767642835840:12345-192.168.203.3@tcp:59:lhsmtool_posix.0 Request processed in 23066us (23300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779393.064061:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 26 00000100:00100000:0.0:1790779393.077166:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779393.077315:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642835968 00000100:00100000:1.0:1790779393.077326:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642835968 00000100:00100000:1.0:1790779393.077423:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:1.0:1790779393.077434:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+9:18672:x1877767642835968:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779393.077456:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779393.077479:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e2c expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077557:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936eb0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077571:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936eb0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077582:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936eb0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077660:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077669:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077676:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077717:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936eb0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077725:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936eb0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077732:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936eb0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077737:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779393.077742:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936eb0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077750:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936eb0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077761:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617e00) 00010000:00010000:1.0:1790779393.077764:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779393.077769:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936eb0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077775:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6800/0xb1aa4014e936eb0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077805:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077914:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077922:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077927:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779393.077930:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077937:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077946:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b771d81aa00) 00010000:00010000:1.0:1790779393.077948:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779393.077952:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077958:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.077992:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb06 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e2c expref: 10 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.078002:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617e00) 00010000:00010000:1.0:1790779393.078005:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779393.078015:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e2c expref: 10 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.078026:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7e00, rc 0) 00000100:00100000:1.0:1790779393.078141:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+9:18672:x1877767642835968:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 709us (984us total) trans 0 rc 301/301 00000100:00100000:1.0:1790779393.078148:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 27 00000100:00100000:0.0:1790779393.083583:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.083705:0:22720:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642836096 00000100:00100000:2.0:1790779393.083714:0:22720:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642836096 00000100:00100000:2.0:1790779393.083799:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:2.0:1790779393.083810:0:22720:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+9:18672:x1877767642836096:12345-192.168.203.3@tcp:700:lfs.0 00000100:00100000:2.0:1790779393.083934:0:22720:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+9:18672:x1877767642836096:12345-192.168.203.3@tcp:700:lfs.0 Request processed in 125us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779393.083950:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1790779393.087548:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.087626:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642836352 00000100:00100000:2.0:1790779393.087636:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642836352 00000100:00100000:2.0:1790779393.087691:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 28 00000100:00100000:2.0:1790779393.087701:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76046cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+9:18672:x1877767642836352:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:2.0:1790779393.087753:0:22711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779393.087777:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8a00/0xb1aa4014e936ea6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425d99 expref: 9 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.087794:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617e00) 00010000:00010000:2.0:1790779393.087799:0:22711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779393.087861:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.087914:0:22711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e09 expref: 5 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.087924:0:22711:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.087958:0:22711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e09 expref: 5 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.087972:0:22711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e09 expref: 5 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779393.087986:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1877767663913856:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779393.088086:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77342c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1790779393.091010:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1877767663913856:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779393.091036:0:22711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779393.091119:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779393.091187:0:22697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642836480 00000100:00100000:3.0:1790779393.091194:0:22697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642836480 00010000:00010000:3.0:1790779393.091240:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e09 expref: 6 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779393.091379:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:3.0:1790779393.091389:0:22697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:2400:x1877767642836480:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779393.091402:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779393.091409:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e09 expref: 6 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.091421:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e09 expref: 6 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.091443:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936eaab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e09 expref: 6 pid: 22711 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.091459:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617e00) 00010000:00010000:3.0:1790779393.091463:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.091488:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.091495:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.091534:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779393.091587:0:22697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2400:x1877767642836480:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 199us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.091594:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00010000:00010000:1.0:1790779393.091995:0:22711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.092004:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.092029:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.092039:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.092047:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790779393.092839:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790779393.094575:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094596:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094607:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790779393.094625:0:22711:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000062bec5cd reply state 000000004468cf78 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094644:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094653:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b771d81a900) 00010000:00010000:1.0:1790779393.094655:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779393.094660:0:22711:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790779393.094666:0:22711:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790779393.094674:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094681:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094688:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094693:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe8e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779393.094698:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094706:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094716:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617e00) 00010000:00010000:1.0:1790779393.094718:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779393.094721:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094727:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eb1b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790779393.094755:0:22711:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000062bec5cd reply state 000000004468cf78 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094764:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.094771:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b771d81aa00) 00010000:00010000:1.0:1790779393.094773:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790779393.094775:0:22711:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1790779393.095127:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76046cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+10:18672:x1877767642836352:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 7422us (7582us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1790779393.095137:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 28 10000000:01000000:3.0:1790779393.128021:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790779393.128028:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b770411d000 from 13 10000000:01000000:3.0:1790779393.128034:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790779393.128080:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936eb30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.128093:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936eb30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.128105:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936eb30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779393.128127:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603a3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663913984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790779393.128190:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779393.128228:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7735d71a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790779393.129763:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663913984 00000100:00100000:1.0:1790779393.129775:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663913984 00000100:00100000:1.0:1790779393.129863:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790779393.129873:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+20:22707:x1877767663913984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779393.129918:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779393.129936:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7603be6800/0xb1aa4014e936eb37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936eb30 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.129964:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7603be6800/0xb1aa4014e936eb37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936eb30 expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.129975:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7603be6800/0xb1aa4014e936eb37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936eb30 expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.129984:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6800, rc 0) 00000100:00100000:1.0:1790779393.130057:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9d73c52-009d-4820-b396-7792bc096088+21:22707:x1877767663913984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779393.130077:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790779393.130201:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603a3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663913984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790779393.130220:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936eb30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb37 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779393.130229:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936eb30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936eb37 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779393.130313:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779393.130347:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779393.130386:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77344b4780 going to sleep for 11 seconds 00000100:00100000:1.0:1790779393.130556:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663914112 00000100:00100000:1.0:1790779393.130561:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663914112 00000100:00100000:1.0:1790779393.130589:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790779393.130596:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+21:22707:x1877767663914112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779393.130685:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+21:22707:x1877767663914112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779393.130692:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790779393.130999:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790779393.131026:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790779393.131069:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779393.131095:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77344b4780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779393.131168:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663914240 00000100:00100000:3.0:1790779393.131173:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663914240 00000100:00100000:3.0:1790779393.131193:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790779393.131199:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:22707:x1877767663914240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779393.131297:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:22707:x1877767663914240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.131310:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790779393.131350:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790779393.132768:0:25755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790779393.134159:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790779393.134190:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790779393.134200:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936eb30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb37 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779393.134212:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7701663e00/0xb1aa4014e936eb30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb37 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790779393.134224:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790779393.134226:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b7603bd9000 from 13 10000000:01000000:0.0:1790779393.134228:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790779393.134514:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936eb3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779393.134524:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936eb3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779393.134534:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936eb3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779393.134556:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790779393.134616:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779393.134654:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77344b4780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779393.134845:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663914368 00000100:00100000:3.0:1790779393.134852:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663914368 00000100:00100000:3.0:1790779393.134937:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790779393.134946:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+21:22707:x1877767663914368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779393.134960:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779393.134972:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701663800/0xb1aa4014e936eb45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936eb3e expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.134999:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701663800/0xb1aa4014e936eb45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936eb3e expref: 22 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.135012:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701663800/0xb1aa4014e936eb45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936eb3e expref: 22 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.135021:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663800, rc 0) 00000100:00100000:3.0:1790779393.135131:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+22:22707:x1877767663914368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.135138:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790779393.135207:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779393.135221:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936eb3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb45 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.135231:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936eb3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936eb45 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779393.135416:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779393.135443:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779393.135509:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77343d93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779393.135548:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663914496 00000100:00100000:3.0:1790779393.135553:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663914496 00000100:00100000:3.0:1790779393.135584:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790779393.135590:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+22:22707:x1877767663914496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779393.136155:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+22:22707:x1877767663914496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 563us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.136162:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790779393.136220:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779393.136422:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779393.136468:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779393.136530:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77343d93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779393.136632:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663914624 00000100:00100000:3.0:1790779393.136703:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663914624 00000100:00100000:3.0:1790779393.136784:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790779393.136794:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+22:22707:x1877767663914624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779393.136913:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+22:22707:x1877767663914624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.136920:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790779393.137025:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790779393.138120:0:25756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790779393.138330:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790779393.138353:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790779393.138364:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936eb3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb45 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.138375:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7718768400/0xb1aa4014e936eb3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb45 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790779393.138386:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790779393.138389:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b770ea1b000 from 13 10000000:01000000:2.0:1790779393.138392:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790779393.138419:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7736fe8a00/0xb1aa4014e936eb4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.138427:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7736fe8a00/0xb1aa4014e936eb4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.138437:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7736fe8a00/0xb1aa4014e936eb4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779393.138456:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790779393.138517:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779393.138552:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77342c0540 going to sleep for 11 seconds 00000100:00100000:3.0:1790779393.138595:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663914752 00000100:00100000:3.0:1790779393.138600:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663914752 00000100:00100000:3.0:1790779393.138642:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790779393.138650:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+22:22707:x1877767663914752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779393.138660:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779393.138670:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701662000/0xb1aa4014e936eb53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936eb4c expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.138690:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701662000/0xb1aa4014e936eb53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936eb4c expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.138700:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701662000/0xb1aa4014e936eb53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936eb4c expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.138709:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701662000, rc 0) 00000100:00100000:3.0:1790779393.138748:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+23:22707:x1877767663914752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.138764:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790779393.139006:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790779393.139028:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7736fe8a00/0xb1aa4014e936eb4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb53 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.139037:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7736fe8a00/0xb1aa4014e936eb4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936eb53 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779393.139090:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779393.139118:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779393.139140:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77342c0540 going to sleep for 11 seconds 00000100:00100000:3.0:1790779393.139210:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663914880 00000100:00100000:3.0:1790779393.139215:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663914880 00000100:00100000:3.0:1790779393.139276:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790779393.139283:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+23:22707:x1877767663914880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790779393.139390:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+23:22707:x1877767663914880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.139397:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790779393.139459:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663914880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779393.139484:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663915008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790779393.139519:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790779393.139619:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77342c0540 going to sleep for 11 seconds 00000100:00100000:1.0:1790779393.139763:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663915008 00000100:00100000:1.0:1790779393.139768:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663915008 00000100:00100000:1.0:1790779393.139788:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790779393.139794:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+23:22707:x1877767663915008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779393.139910:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+23:22707:x1877767663915008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779393.139917:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790779393.139989:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663915008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790779393.141014:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790779393.141263:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790779393.141281:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790779393.141289:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7736fe8a00/0xb1aa4014e936eb4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb53 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.141300:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7736fe8a00/0xb1aa4014e936eb4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb53 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790779393.141309:0:22707:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790779393.141311:0:22707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b773c016000 from 13 10000000:01000000:1.0:1790779393.141314:0:22707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790779393.141338:0:22707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936eb5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.141346:0:22707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936eb5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.141354:0:22707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936eb5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779393.141370:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663915136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790779393.141411:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779393.141484:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c780 going to sleep for 11 seconds 00000100:00100000:3.0:1790779393.141515:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663915136 00000100:00100000:3.0:1790779393.141520:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663915136 00000100:00100000:3.0:1790779393.141580:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790779393.141589:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+23:22707:x1877767663915136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790779393.141599:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790779393.141609:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b7701663a00/0xb1aa4014e936eb61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1aa4014e936eb5a expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.141627:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b7701663a00/0xb1aa4014e936eb61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1aa4014e936eb5a expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.141647:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b7701663a00/0xb1aa4014e936eb61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1aa4014e936eb5a expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.141655:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7701663a00, rc 0) 00000100:00100000:3.0:1790779393.141693:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+24:22707:x1877767663915136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.141699:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790779393.141755:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663915136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790779393.141767:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936eb5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb61 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.141775:0:22707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936eb5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1aa4014e936eb61 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779393.141816:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663915264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779393.141838:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779393.142564:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c780 going to sleep for 11 seconds 00000100:00100000:2.0:1790779393.142604:0:22705:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663915264 00000100:00100000:2.0:1790779393.142609:0:22705:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663915264 00000100:00100000:2.0:1790779393.142674:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790779393.142682:0:22705:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+24:22707:x1877767663915264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790779393.142800:0:22705:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9d73c52-009d-4820-b396-7792bc096088+24:22707:x1877767663915264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779393.142807:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790779393.142864:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663915264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790779393.142942:0:22707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663915392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790779393.142981:0:22707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779393.143099:0:22707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c300 going to sleep for 11 seconds 00000100:00100000:3.0:1790779393.143134:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663915392 00000100:00100000:3.0:1790779393.143144:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663915392 00000100:00100000:3.0:1790779393.143163:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790779393.143168:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+24:22707:x1877767663915392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790779393.143694:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+24:22707:x1877767663915392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 524us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.143701:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790779393.143770:0:22707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e9d73c52-009d-4820-b396-7792bc096088:22707:1877767663915392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790779393.144564:0:25758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790779393.144701:0:22707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790779393.144722:0:22707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790779393.144732:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936eb5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb61 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.144741:0:22707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.103@tcp lock: ffff9b7603be6400/0xb1aa4014e936eb5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1aa4014e936eb61 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779393.195717:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.195828:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642836608 00000100:00100000:2.0:1790779393.195838:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642836608 00000100:00100000:2.0:1790779393.195934:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:2.0:1790779393.195944:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+10:18680:x1877767642836608:12345-192.168.203.3@tcp:101:lctl.0 00010000:00010000:2.0:1790779393.195985:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779393.196009:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eb68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e33 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.196074:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eb6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.196090:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eb6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.196101:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eb6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.196143:0:22713:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790779393.196147:0:22713:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779393.196199:0:22713:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eb6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.196224:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eb68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e33 expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.196242:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9000/0xb1aa4014e936eb6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e33 expref: 11 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.196251:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617d00) 00010000:00010000:2.0:1790779393.196255:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779393.196258:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe9000, rc 0) 00000100:00100000:2.0:1790779393.196337:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+11:18680:x1877767642836608:12345-192.168.203.3@tcp:101:lctl.0 Request processed in 394us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779393.196344:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 29 00000100:00100000:0.0:1790779393.236252:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.236475:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642836736 00000100:00100000:2.0:1790779393.236494:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642836736 00000100:00100000:2.0:1790779393.236547:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:2.0:1790779393.236557:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:18681:x1877767642836736:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779393.236577:0:25109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779393.236597:0:25109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eb76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e3a expref: -99 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.236660:0:25109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8200/0xb1aa4014e936eb7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.236674:0:25109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8200/0xb1aa4014e936eb7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.236684:0:25109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8200/0xb1aa4014e936eb7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.236725:0:25109:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790779393.236728:0:25109:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779393.236749:0:25109:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8200/0xb1aa4014e936eb7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.236772:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eb76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e3a expref: 7 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.236978:0:25109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8200/0xb1aa4014e936eb7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e3a expref: 6 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.236988:0:25109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617d00) 00010000:00010000:2.0:1790779393.236991:0:25109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779393.237009:0:25109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe8200, rc 0) 00000100:00100000:2.0:1790779393.237062:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:18681:x1877767642836736:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 507us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779393.237069:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 30 00000100:00100000:3.0:1790779393.250712:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779393.251267:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642836864 00000100:00100000:1.0:1790779393.251279:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642836864 00000100:00100000:1.0:1790779393.251340:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:1.0:1790779393.251350:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:18681:x1877767642836864:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:1.0:1790779393.251371:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779393.251389:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936eb84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e41 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251469:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936eb8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251483:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936eb8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251494:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936eb8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251505:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936eb92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251512:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251518:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251593:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936eb99 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251602:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936eb99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251608:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936eb99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779393.251644:0:22712:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790779393.251648:0:22712:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779393.251678:0:22712:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936eb99 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251703:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936eb8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251709:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936eb8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251716:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936eb8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251721:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779393.251726:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936eb8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251733:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936eb8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251745:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617d00) 00010000:00010000:1.0:1790779393.251748:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779393.251752:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936eb8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251758:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936eb8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251771:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251776:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936eb92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251781:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936eb92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251804:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779393.251807:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936eb92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251812:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936eb92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251820:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b771d81aa00) 00010000:00010000:1.0:1790779393.251822:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779393.251825:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936eb92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.251830:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936eb92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.252242:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936eb84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e41 expref: 8 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.252257:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936eb99 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e41 expref: 7 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.252264:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b771d81a900) 00010000:00010000:1.0:1790779393.252266:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790779393.252268:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6a00, rc 0) 00000100:00100000:1.0:1790779393.252322:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+7:18681:x1877767642836864:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 973us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779393.252329:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 31 00000100:00100000:0.0:1790779393.257212:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779393.257358:0:22723:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642836992 00000100:00100000:3.0:1790779393.257368:0:22723:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642836992 00000100:00100000:3.0:1790779393.257439:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1790779393.257449:0:22723:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:18681:x1877767642836992:12345-192.168.203.3@tcp:900:lfs.0 00000100:00100000:3.0:1790779393.257527:0:22723:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:18681:x1877767642836992:12345-192.168.203.3@tcp:900:lfs.0 Request processed in 80us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.257535:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00080000:2.0:1790779393.257600:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790779393.264055:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.264148:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642837248 00000100:00100000:2.0:1790779393.264158:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642837248 00000100:00100000:2.0:1790779393.264221:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:2.0:1790779393.264231:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+7:18681:x1877767642837248:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779393.264261:0:25109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779393.264280:0:25109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eba0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e48 expref: -99 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.264375:0:25109:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790779393.264473:0:25109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eba0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e48 expref: 9 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.264487:0:25109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617d00) 00010000:00010000:2.0:1790779393.264490:0:25109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779393.264496:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936eba0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e48 expref: 9 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.264509:0:25109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe8600, rc 0) 00000100:00100000:2.0:1790779393.264570:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+8:18681:x1877767642837248:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 341us (525us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1790779393.264577:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 32 00000100:00100000:1.0:1790779393.273554:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.273654:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642837504 00000100:00100000:2.0:1790779393.273673:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642837504 00000100:00100000:2.0:1790779393.273737:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:2.0:1790779393.273747:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+8:18681:x1877767642837504:12345-192.168.203.3@tcp:36:lfs.0 00010000:00010000:2.0:1790779393.273816:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779393.273851:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936eb99 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e41 expref: 8 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.273870:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b771d81a900) 00010000:00010000:2.0:1790779393.273932:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790779393.273955:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.273970:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.273979:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779393.274166:0:22713:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000920397f3 reply state 000000000491ea2f transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.274180:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.274186:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b771d81a900) 00010000:00010000:2.0:1790779393.274189:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1790779393.274192:0:22713:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790779393.274199:0:22713:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790779393.274281:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+9:18681:x1877767642837504:12345-192.168.203.3@tcp:36:lfs.0 Request processed in 535us (735us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1790779393.274289:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 33 00000100:00100000:0.0:1790779393.276779:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.276870:0:22715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642837760 00000100:00100000:2.0:1790779393.276912:0:22715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642837760 00000100:00100000:2.0:1790779393.276962:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1790779393.276971:0:22715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+9:18681:x1877767642837760:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779393.277174:0:22715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+10:18681:x1877767642837760:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 204us (404us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1790779393.277183:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:0.0:1790779393.282313:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.282577:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642838016 00000100:00100000:2.0:1790779393.282592:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642838016 00000100:00100000:2.0:1790779393.282671:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:2.0:1790779393.282683:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+10:18681:x1877767642838016:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779393.282717:0:25109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779393.282744:0:25109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ebb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e4f expref: -99 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.282860:0:25109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ebbc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.282930:0:25109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ebbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.282945:0:25109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ebbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.282958:0:25109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ebc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.282965:0:25109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ebc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.282986:0:25109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ebc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.283121:0:25109:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790779393.283214:0:25109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ebbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283416:0:25109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ebbc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283424:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ebbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283430:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe9800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779393.283436:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ebbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283444:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ebbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283459:0:25109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617d00) 00010000:00010000:2.0:1790779393.283462:0:25109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779393.283467:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ebbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283474:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ebbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283491:0:25109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ebc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283508:0:25109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ebc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283514:0:25109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ebc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283519:0:25109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe8c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779393.283522:0:25109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ebc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283527:0:25109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ebc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283535:0:25109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b771d81aa00) 00010000:00010000:2.0:1790779393.283538:0:25109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779393.283540:0:25109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ebc3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283545:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ebc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283588:0:25109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ebb5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e4f expref: 12 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283599:0:25109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617d00) 00010000:00010000:2.0:1790779393.283601:0:25109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779393.283605:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ebb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e4f expref: 12 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.283626:0:25109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe9400, rc 0) 00000100:00100000:2.0:1790779393.283707:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bc9b911-71a6-4cae-bee1-5750e3e7a595+11:18681:x1877767642838016:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1027us (1411us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1790779393.283716:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 34 00000100:00100000:1.0:1790779393.286735:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.287071:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642838144 00000100:00100000:2.0:1790779393.287088:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642838144 00000100:00100000:2.0:1790779393.287164:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:2.0:1790779393.287176:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+11:18681:x1877767642838144:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779393.287209:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779393.287921:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ebd1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e56 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.288067:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.288085:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.288098:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.288131:0:22713:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790779393.288136:0:22713:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779393.288161:0:22713:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.288195:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ebd1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e56 expref: 13 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.288263:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e56 expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.288274:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b771d81a900) 00010000:00010000:2.0:1790779393.288277:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790779393.288282:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe8e00, rc 0) 00000100:00100000:2.0:1790779393.288363:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+12:18681:x1877767642838144:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1189us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779393.288372:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 35 00000100:00100000:0.0:1790779393.292959:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.293080:0:22715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642838272 00000100:00100000:2.0:1790779393.293093:0:22715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642838272 00000100:00100000:2.0:1790779393.293162:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:2.0:1790779393.293173:0:22715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+12:18681:x1877767642838272:12345-192.168.203.3@tcp:37:lfs.0 00000100:00100000:2.0:1790779393.298678:0:22715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+12:18681:x1877767642838272:12345-192.168.203.3@tcp:37:lfs.0 Request processed in 5488us (5714us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779393.298697:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 3 00000100:00100000:1.0:1790779393.303313:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779393.303431:0:22714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642838528 00000100:00100000:3.0:1790779393.303445:0:22714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642838528 00000100:00100000:3.0:1790779393.303548:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:3.0:1790779393.303561:0:22714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734357c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+12:18681:x1877767642838528:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:3.0:1790779393.303972:0:22714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734357c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+13:18681:x1877767642838528:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 412us (673us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1790779393.303997:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4 00000100:00100000:0.0:1790779393.357966:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779393.358079:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642838656 00000100:00100000:1.0:1790779393.358093:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642838656 00000100:00100000:1.0:1790779393.358177:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:1.0:1790779393.358189:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+11:18687:x1877767642838656:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1790779393.358218:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779393.358246:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ebdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e5d expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358345:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ebe6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358363:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ebe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358377:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ebe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358390:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358399:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358405:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358502:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936ebf4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358510:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936ebf4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358535:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936ebf4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790779393.358578:0:22711:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790779393.358583:0:22711:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790779393.358632:0:22711:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936ebf4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358646:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ebe6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358653:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ebe6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.358662:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ebe6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359053:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779393.359058:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ebe6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359067:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ebe6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359082:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617d00) 00010000:00010000:1.0:1790779393.359086:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779393.359091:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ebe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359098:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ebe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359130:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359136:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359142:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359147:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779393.359150:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359156:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359165:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b771d81aa00) 00010000:00010000:1.0:1790779393.359167:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779393.359170:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359181:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359215:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ebdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e5d expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359231:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6a00/0xb1aa4014e936ebf4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e5d expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.359356:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b771d81a900) 00010000:00010000:1.0:1790779393.359359:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790779393.359362:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be6a00, rc 0) 00000100:00100000:1.0:1790779393.359518:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+12:18687:x1877767642838656:12345-192.168.203.3@tcp:101:bash.0 Request processed in 1329us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779393.359528:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 36 00000100:00100000:0.0:1790779393.366217:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779393.366576:0:22723:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642838784 00000100:00100000:3.0:1790779393.366590:0:22723:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642838784 00000100:00100000:3.0:1790779393.366828:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:3.0:1790779393.366842:0:22723:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:18687:x1877767642838784:12345-192.168.203.3@tcp:900:bash.0 00000100:00100000:3.0:1790779393.367160:0:22723:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:18687:x1877767642838784:12345-192.168.203.3@tcp:900:bash.0 Request processed in 320us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.367169:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1790779393.371639:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779393.371990:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642839040 00000100:00100000:1.0:1790779393.372004:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642839040 00000100:00100000:1.0:1790779393.372086:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 37 00000100:00100000:1.0:1790779393.372099:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+12:18687:x1877767642839040:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1790779393.372129:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779393.372156:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebfb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e64 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.372582:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.372603:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e56 expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.372613:0:22712:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.372657:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e56 expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779393.373045:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e56 expref: 12 pid: 22713 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779393.373081:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773b7abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1877767663915520:192.168.203.3@tcp:104: 00000100:00100000:1.0:1790779393.373199:0:22712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854c780 going to sleep for 11 seconds 00000100:00100000:1.0:1790779393.377066:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779393.377152:0:22696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642839168 00000100:00100000:3.0:1790779393.377163:0:22696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642839168 00010000:00010000:3.0:1790779393.377213:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e56 expref: 13 pid: 22713 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779393.377260:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1790779393.377270:0:22696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+13:2401:x1877767642839168:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779393.377289:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779393.377297:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e56 expref: 13 pid: 22713 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.377312:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e56 expref: 13 pid: 22713 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.377339:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b771d81a900) 00010000:00010000:3.0:1790779393.377345:0:22696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.377378:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.377388:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.377412:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779393.377489:0:22696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+13:2401:x1877767642839168:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 219us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.377497:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00010000:00010000:2.0:1790779393.377818:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ebd8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e56 expref: 12 pid: 22713 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779393.377839:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773b7abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1877767663915520:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779393.378046:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.378058:0:22712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.378077:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.378326:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.378350:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.378364:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.378852:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ec10 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.378863:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ec10 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.378870:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ec10 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.378955:0:22712:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790779393.379233:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.379242:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.379249:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.379256:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779393.379274:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.379282:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.379347:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b771d81a900) 00010000:00010000:2.0:1790779393.379352:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790779393.379357:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.379363:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7c00/0xb1aa4014e936ec02 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790779393.379379:0:22712:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000205f1334 reply state 000000006bfb4e7d transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.379392:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.379398:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9b7603617000) 00010000:00010000:2.0:1790779393.379401:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790779393.379403:0:22712:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790779393.379496:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6e00/0xb1aa4014e936ebfb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e64 expref: 15 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.379515:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ec10 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e64 expref: 14 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.379522:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:2.0:1790779393.379524:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1790779393.379533:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe9400, rc 0) 00000100:00100000:2.0:1790779393.379602:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+15:18687:x1877767642839040:12345-192.168.203.3@tcp:101:bash.0 Request processed in 7505us (7978us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1790779393.379610:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 37 00010000:00010000:3.0:1790779393.384804:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790779393.395148:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.395270:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642839296 00000100:00100000:2.0:1790779393.395293:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642839296 00000100:00100000:2.0:1790779393.395375:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:2.0:1790779393.395386:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+15:18687:x1877767642839296:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1790779393.395423:0:25109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779393.395452:0:25109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec1e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e6b expref: -99 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.395543:0:25109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.395561:0:25109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.395574:0:25109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.395636:0:25109:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790779393.395641:0:25109:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790779393.395673:0:25109:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.395685:0:25109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.395716:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec1e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e6b expref: 17 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.395763:0:25109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e6b expref: 16 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.395772:0:25109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:2.0:1790779393.395776:0:25109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779393.395780:0:25109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe8c00, rc 0) 00000100:00100000:2.0:1790779393.395950:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+16:18687:x1877767642839296:12345-192.168.203.3@tcp:101:bash.0 Request processed in 566us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779393.395959:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 38 00000100:00100000:3.0:1790779393.400332:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.400522:0:22715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642839552 00000100:00100000:2.0:1790779393.400535:0:22715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642839552 00000100:00100000:2.0:1790779393.400613:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:2.0:1790779393.400625:0:22715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+16:18687:x1877767642839552:12345-192.168.203.3@tcp:35:bash.0 00000100:00100000:2.0:1790779393.401115:0:22715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773f51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+17:18687:x1877767642839552:12345-192.168.203.3@tcp:35:bash.0 Request processed in 490us (796us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1790779393.401125:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 5 00000100:00100000:3.0:1790779393.504763:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.504926:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642839808 00000100:00100000:2.0:1790779393.504939:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642839808 00000100:00100000:2.0:1790779393.505019:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:2.0:1790779393.505031:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+17:18697:x1877767642839808:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779393.505077:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779393.505104:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e72 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.505243:0:22713:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790779393.505410:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e72 expref: 19 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.505501:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b7603617d00) 00010000:00010000:2.0:1790779393.505506:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779393.505513:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e72 expref: 19 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.505531:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe8e00, rc 0) 00000100:00100000:2.0:1790779393.505609:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+18:18697:x1877767642839808:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 580us (861us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1790779393.505618:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 39 00000100:00100000:1.0:1790779393.509843:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.514225:0:22715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642840064 00000100:00100000:2.0:1790779393.514259:0:22715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642840064 00000100:00100000:2.0:1790779393.514516:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:2.0:1790779393.514529:0:22715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+18:18697:x1877767642840064:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779393.514866:0:22715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+19:18697:x1877767642840064:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 339us (5037us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1790779393.514906:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 6 00000100:00100000:3.0:1790779393.570760:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.570848:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642840320 00000100:00100000:2.0:1790779393.570863:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642840320 00000100:00100000:2.0:1790779393.571001:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:2.0:1790779393.571015:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+19:18700:x1877767642840320:12345-192.168.203.3@tcp:101:lfs.0 00010000:00010000:2.0:1790779393.571061:0:25109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779393.571087:0:25109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec3a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e79 expref: -99 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.571636:0:25109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec41 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.571656:0:25109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.571670:0:25109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.571683:0:25109:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790779393.571849:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec3a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e79 expref: 22 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.571979:0:25109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec41 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e79 expref: 21 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.571991:0:25109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:2.0:1790779393.571994:0:25109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779393.571998:0:25109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe9800, rc 0) 00000100:00100000:2.0:1790779393.572094:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+21:18700:x1877767642840320:12345-192.168.203.3@tcp:101:lfs.0 Request processed in 1082us (1348us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1790779393.572103:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 40 00000100:00100000:1.0:1790779393.579186:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.579304:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642840448 00000100:00100000:2.0:1790779393.579318:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642840448 00000100:00100000:2.0:1790779393.579416:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:2.0:1790779393.579429:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+21:18700:x1877767642840448:12345-192.168.203.3@tcp:54:lfs.0 00010000:00010000:2.0:1790779393.579535:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec4f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.579563:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.579577:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.579623:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.579632:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec4f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.579640:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec4f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.579646:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe8e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779393.579651:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec4f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.579660:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec4f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.579673:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:2.0:1790779393.579676:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779393.579682:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec4f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.579689:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec4f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779393.579782:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+21:18700:x1877767642840448:12345-192.168.203.3@tcp:54:lfs.0 Request processed in 356us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779393.579804:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 41 00000100:00100000:0.0:1790779393.584972:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779393.585161:0:22697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642840704 00000100:00100000:3.0:1790779393.585175:0:22697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642840704 00000100:00100000:3.0:1790779393.585271:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1790779393.585283:0:22697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+21:2401:x1877767642840704:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779393.585304:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779393.585338:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec41 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e79 expref: 21 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.585358:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:3.0:1790779393.585363:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779393.585436:0:22697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+20:2401:x1877767642840704:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 156us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.585444:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:3.0:1790779393.588109:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.591120:0:22715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642840832 00000100:00100000:2.0:1790779393.591141:0:22715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642840832 00000100:00100000:2.0:1790779393.591281:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:2.0:1790779393.591294:0:22715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+20:18700:x1877767642840832:12345-192.168.203.3@tcp:35:lfs.0 00000100:00100000:2.0:1790779393.591624:0:22715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+21:18700:x1877767642840832:12345-192.168.203.3@tcp:35:lfs.0 Request processed in 331us (3529us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1790779393.591634:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 7 00000100:00100000:1.0:1790779393.641296:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790779393.641329:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663915648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790779393.641428:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779393.641743:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663915648 00000100:00100000:3.0:1790779393.641754:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663915648 00000100:00100000:3.0:1790779393.641842:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790779393.641855:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663915648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790779393.641941:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790779393.642003:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663915648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.642010:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1790779393.642092:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790779393.642669:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663915648:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1790779393.770137:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1790779393.833145:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790779393.926920:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779393.929517:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642841088 00000100:00100000:2.0:1790779393.929541:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642841088 00000100:00100000:2.0:1790779393.929810:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:2.0:1790779393.929824:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+21:18731:x1877767642841088:12345-192.168.203.3@tcp:101:cat.0 00010000:00010000:2.0:1790779393.929860:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779393.929919:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec56 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e80 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.930071:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec5d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.930090:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec5d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.930104:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec5d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779393.930118:0:22711:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790779393.931033:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec56 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e80 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.931076:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec5d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e80 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779393.931087:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:2.0:1790779393.931091:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779393.931094:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe9a00, rc 0) 00000100:00100000:2.0:1790779393.931361:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+23:18731:x1877767642841088:12345-192.168.203.3@tcp:101:cat.0 Request processed in 1539us (4498us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1790779393.931371:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 42 00000100:00100000:0.0:1790779393.946727:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779393.946946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779393.947100:0:22714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642841472 00000100:00100000:1.0:1790779393.947114:0:22714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642841472 00000100:00100000:1.0:1790779393.947256:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:1.0:1790779393.947269:0:22714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+23:18731:x1877767642841472:12345-192.168.203.3@tcp:35:cat.0 00000100:00100000:3.0:1790779393.947731:0:22696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642841216 00000100:00100000:3.0:1790779393.947738:0:22696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642841216 00000100:00100000:3.0:1790779393.947805:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:3.0:1790779393.947815:0:22696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+24:2401:x1877767642841216:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779393.947830:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779393.948045:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec5d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e80 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779393.948074:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:3.0:1790779393.948080:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779393.948458:0:22714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+24:18731:x1877767642841472:12345-192.168.203.3@tcp:35:cat.0 Request processed in 1191us (1510us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1790779393.948467:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8 00000100:00100000:3.0:1790779393.948556:0:22696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+24:2401:x1877767642841216:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 743us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779393.948564:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:3.0:1790779394.028553:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.028933:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642841728 00000100:00100000:2.0:1790779394.028947:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642841728 00000100:00100000:2.0:1790779394.029031:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:2.0:1790779394.029042:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+23:18737:x1877767642841728:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1790779394.029074:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779394.029101:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec6b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e87 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.029353:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec72 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.029371:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ec10 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e64 expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.029380:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e6b expref: 24 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.029410:0:22712:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec72 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.029453:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e6b expref: 24 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.029470:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e6b expref: 24 pid: 25109 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779394.029485:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c53800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1877767663915776:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779394.030289:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ec10 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e64 expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.030302:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ec10 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e64 expref: 24 pid: 22712 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779394.030313:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1877767663915904:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779394.030420:0:22712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7710897cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779394.040090:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779394.040135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.040281:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c53800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1877767663915776:192.168.203.3@tcp:104: 00000100:00100000:2.0:1790779394.040297:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1877767663915904:192.168.203.3@tcp:104: 00010000:00010000:2.0:1790779394.040332:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec72 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779394.041273:0:22697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642841856 00000100:00100000:0.0:1790779394.041288:0:22697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642841856 00010000:00010000:0.0:1790779394.041346:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e6b expref: 25 pid: 25109 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779394.041395:0:22697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642841984 00000100:00100000:0.0:1790779394.041399:0:22697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642841984 00010000:00010000:0.0:1790779394.041414:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ec10 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e64 expref: 26 pid: 22712 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779394.041449:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:0.0:1790779394.041459:0:22697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+26:2400:x1877767642841856:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790779394.041478:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790779394.041485:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e6b expref: 26 pid: 25109 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.041498:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e6b expref: 26 pid: 25109 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.041529:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ec25 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e6b expref: 26 pid: 25109 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.041568:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:0.0:1790779394.041574:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec72 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.041583:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec72 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.041591:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790779394.041592:0:25741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 18 00000100:00100000:1.0:1790779394.041602:0:25741:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760316f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+25:2400:x1877767642841984:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790779394.041613:0:25741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790779394.041618:0:25741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ec10 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e64 expref: 25 pid: 22712 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779394.041639:0:25741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ec10 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e64 expref: 25 pid: 22712 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779394.041653:0:25741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ec10 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e64 expref: 25 pid: 22712 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779394.041664:0:25741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:1.0:1790779394.041668:0:25741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec72 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779394.041676:0:25741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec72 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779394.041684:0:25741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec72 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779394.041711:0:25741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779394.041719:0:22712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec72 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.041727:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec72 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779394.041750:0:22712:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000100:00100000:1.0:1790779394.041779:0:25741:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760316f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+24:2400:x1877767642841984:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 179us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779394.041786:0:25741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 18 00010000:00010000:3.0:1790779394.041981:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936ec6b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e87 expref: 25 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.041997:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9a00/0xb1aa4014e936ec72 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e87 expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.042005:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:3.0:1790779394.042008:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790779394.042011:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe9a00, rc 0) 00000100:00100000:3.0:1790779394.042051:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+24:18737:x1877767642841728:12345-192.168.203.3@tcp:101:dd.0 Request processed in 13012us (13515us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1790779394.042058:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 43 00000100:00100000:0.0:1790779394.042214:0:22697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+23:2400:x1877767642841856:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 755us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779394.042222:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:3.0:1790779394.064539:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779394.064754:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642842112 00000100:00100000:0.0:1790779394.064769:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642842112 00000100:00100000:0.0:1790779394.064852:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:0.0:1790779394.064864:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+23:18737:x1877767642842112:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:0.0:1790779394.064945:0:25109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779394.064972:0:25109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ec80 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e8e expref: -99 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.065019:0:25109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ec87 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.065038:0:25109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ec87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.065052:0:25109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ec87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.065233:0:25109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ec80 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e8e expref: 25 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.065256:0:25109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ec87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e8e expref: 24 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.065266:0:25109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:0.0:1790779394.065269:0:25109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790779394.065273:0:25109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769200, rc 0) 00000100:00100000:0.0:1790779394.065360:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+24:18737:x1877767642842112:12345-192.168.203.3@tcp:101:dd.0 Request processed in 497us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779394.065368:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44 00000100:00100000:1.0:1790779394.068294:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779394.068384:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642842368 00000100:00100000:0.0:1790779394.068398:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642842368 00000100:00100000:0.0:1790779394.068482:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45 00000100:00100000:0.0:1790779394.068495:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+24:18737:x1877767642842368:12345-192.168.203.3@tcp:36:dd.0 00010000:00010000:0.0:1790779394.069064:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.069087:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.069100:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790779394.069345:0:22713:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1790779394.069371:0:22713:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e06f6a19 reply state 00000000de393b32 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.069406:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.069414:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:0.0:1790779394.069417:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790779394.069421:0:22713:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790779394.069691:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+27:18737:x1877767642842368:12345-192.168.203.3@tcp:36:dd.0 Request processed in 1196us (1411us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1790779394.069701:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45 00000020:00080000:0.0:1790779394.069707:0:22713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790779394.075378:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779394.075473:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642842496 00000100:00100000:0.0:1790779394.075497:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642842496 00000100:00100000:0.0:1790779394.075578:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:0.0:1790779394.075590:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+27:18737:x1877767642842496:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:0.0:1790779394.075631:0:25109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779394.075658:0:25109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ec95 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e95 expref: -99 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.075733:0:25109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ec95 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e95 expref: 28 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.075752:0:25109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ec95 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e95 expref: 28 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.075776:0:25109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:0.0:1790779394.075780:0:25109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790779394.075784:0:25109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769400, rc 0) 00000100:00100000:0.0:1790779394.075917:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+28:18737:x1877767642842496:12345-192.168.203.3@tcp:101:dd.0 Request processed in 329us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779394.075926:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46 00000100:00100000:3.0:1790779394.109129:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.109277:0:22696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642842752 00000100:00100000:2.0:1790779394.109292:0:22696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642842752 00000100:00100000:2.0:1790779394.109397:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:2.0:1790779394.109408:0:22696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+28:18737:x1877767642842752:12345-192.168.203.3@tcp:103:dd.0 00010000:00010000:2.0:1790779394.109428:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779394.109460:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ec95 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e95 expref: 28 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.109492:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:2.0:1790779394.109499:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779394.109581:0:22696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+27:18737:x1877767642842752:12345-192.168.203.3@tcp:103:dd.0 Request processed in 173us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779394.109589:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 2 00000100:00100000:1.0:1790779394.112790:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.112951:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642842880 00000100:00100000:2.0:1790779394.112965:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642842880 00000100:00100000:2.0:1790779394.113042:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:2.0:1790779394.113052:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+27:18737:x1877767642842880:12345-192.168.203.3@tcp:58:dd.0 00010000:00010000:2.0:1790779394.113217:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.113240:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.113254:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790779394.126061:0:22712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790779394.126114:0:22712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1790779394.126317:0:22712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1790779394.126477:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+27:18737:x1877767642842880:12345-192.168.203.3@tcp:58:dd.0 Request processed in 13417us (13692us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779394.126500:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 47 00000100:00100000:0.0:1790779394.135052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.135191:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642843008 00000100:00100000:2.0:1790779394.135206:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642843008 00000100:00100000:2.0:1790779394.135290:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 48 00000100:00100000:2.0:1790779394.135302:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+27:18737:x1877767642843008:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:2.0:1790779394.135331:0:25109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779394.135361:0:25109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eca3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425e9c expref: -99 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.135442:0:25109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.135456:0:25109:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eca3 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e9c expref: 28 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.135490:0:25109:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.135506:0:25109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eca3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e9c expref: 28 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.135523:0:25109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:2.0:1790779394.135526:0:25109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790779394.135530:0:25109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eca3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e9c expref: 28 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.135539:0:25109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe8e00, rc 0) 00000100:00100000:2.0:1790779394.135623:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+28:18737:x1877767642843008:12345-192.168.203.3@tcp:101:dd.0 Request processed in 324us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779394.135650:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 48 00010000:00010000:2.0:1790779394.410422:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790779394.664614:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663916032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790779394.664719:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790779394.668235:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663916032 00000100:00100000:1.0:1790779394.668259:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663916032 00000100:00100000:1.0:1790779394.669155:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790779394.669176:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663916032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790779394.669232:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1790779394.669582:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1877767663916032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 412us (4861us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779394.669591:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790779394.669714:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1877767663916032:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1790779394.792242:0:22744:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790779394.792256:0:22744:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790779394.792294:0:22744:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1790779394.792308:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1790779394.792496:0:22744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704140e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22744:1877767663916160:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790779394.792633:0:22744:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b7603808840 going to sleep for 11 seconds 00000100:00100000:0.0:1790779394.797359:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.797495:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642843136 00000100:00100000:2.0:1790779394.797508:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642843136 00000100:00100000:2.0:1790779394.797592:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:2.0:1790779394.797604:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+29:18738:x1877767642843136:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790779394.797649:0:22713:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790779394.797823:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+29:18738:x1877767642843136:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 221us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779394.797832:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 49 00000100:00100000:3.0:1790779394.799588:0:22744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704140e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22744:1877767663916160:192.168.203.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790779394.808449:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779394.808578:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642843264 00000100:00100000:3.0:1790779394.808592:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642843264 00000100:00100000:3.0:1790779394.808669:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:3.0:1790779394.808679:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+28:18738:x1877767642843264:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790779394.808774:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ecaa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.808794:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ecaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.808808:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ecaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809070:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecb1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809091:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809103:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809134:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ecb8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809144:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ecb8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809150:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ecb8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790779394.809201:0:22711:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790779394.809220:0:22711:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790779394.809237:0:22711:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ecb8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809249:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ecaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809255:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ecaa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809263:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ecaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809269:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779394.809273:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ecaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809280:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ecaa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809291:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603617500) 00010000:00010000:3.0:1790779394.809293:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779394.809297:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ecaa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809304:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ecaa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809318:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809323:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecb1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809340:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecb1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809345:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779394.809348:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecb1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809354:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecb1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809361:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9b7703b30400) 00010000:00010000:3.0:1790779394.809364:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779394.809366:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecb1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809372:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecb1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809386:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ecb8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809393:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ecb8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809399:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ecb8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809413:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779394.809416:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ecb8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809498:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ecb8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809507:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:3.0:1790779394.809509:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779394.809512:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ecb8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.809518:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ecb8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779394.809608:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+28:18738:x1877767642843264:12345-192.168.203.3@tcp:34:lhsmtool_posix.0 Request processed in 926us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779394.809617:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 50 00000100:00100000:1.0:1790779394.821629:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.821752:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642843520 00000100:00100000:2.0:1790779394.821766:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642843520 00000100:00100000:2.0:1790779394.821858:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:2.0:1790779394.821923:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+28:18738:x1877767642843520:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779394.821950:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779394.821977:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ecbf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ea3 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822112:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ecc6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822132:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ecc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822147:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ecc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790779394.822161:0:22713:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790779394.822292:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ecc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822302:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ecc6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822310:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ecc6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822317:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe9400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779394.822323:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ecc6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822332:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ecc6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822346:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:2.0:1790779394.822349:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790779394.822355:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ecc6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822362:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9400/0xb1aa4014e936ecc6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822429:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ecbf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ea3 expref: 30 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822441:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b7603617500) 00010000:00010000:2.0:1790779394.822444:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790779394.822448:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8c00/0xb1aa4014e936ecbf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ea3 expref: 30 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.822471:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7736fe8c00, rc 0) 00000100:00100000:2.0:1790779394.822556:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+29:18738:x1877767642843520:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 679us (941us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1790779394.822565:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 51 00000100:00100000:0.0:1790779394.826323:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779394.826422:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642843648 00000100:00100000:3.0:1790779394.826434:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642843648 00000100:00100000:3.0:1790779394.826503:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:3.0:1790779394.826514:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7711bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+29:18738:x1877767642843648:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790779394.826559:0:22711:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790779394.826713:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7711bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+29:18738:x1877767642843648:12345-192.168.203.3@tcp:53:lhsmtool_posix.0 Request processed in 201us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779394.826721:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 52 00000100:00100000:0.0:1790779394.830622:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.830712:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642843904 00000100:00100000:2.0:1790779394.830726:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642843904 00000100:00100000:2.0:1790779394.830809:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:2.0:1790779394.830823:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+29:18738:x1877767642843904:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779394.830870:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779394.830937:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ecd4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425eaa expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790779394.831575:0:22713:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =60 00000004:00080000:2.0:1790779394.831585:0:22713:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1790779394.831603:0:22713:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1790779394.831798:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936ecdb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.831817:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936ecdb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.831831:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936ecdb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.836563:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ecd4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eaa expref: 32 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.836635:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936ecdb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eaa expref: 31 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.836646:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603617c00) 00010000:00010000:2.0:1790779394.836649:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790779394.836653:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a2400, rc 0) 00000100:00100000:2.0:1790779394.836746:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b760300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+31:18738:x1877767642843904:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 5925us (6137us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1790779394.836758:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 53 00000100:00100000:1.0:1790779394.847025:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779394.847356:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642844160 00000100:00100000:3.0:1790779394.847368:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642844160 00000100:00100000:3.0:1790779394.847445:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:3.0:1790779394.847457:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+31:18738:x1877767642844160:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790779394.847552:0:22711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779394.847607:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a2400/0xb1aa4014e936ecdb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eaa expref: 31 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847629:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603617c00) 00010000:00010000:3.0:1790779394.847643:0:22711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779394.847673:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ece9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847690:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ece9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847700:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ece9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847716:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecf0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1e8f3fff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847724:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecf0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1e8f3fff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847731:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecf0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1e8f3fff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847794:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ece9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847802:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ece9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847809:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ece9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847815:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779394.847826:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ece9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847835:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ece9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847844:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b771d81a900) 00010000:00010000:3.0:1790779394.847847:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779394.847852:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ece9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847859:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662800/0xb1aa4014e936ece9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847936:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecf0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1e8f3fff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847943:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecf0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1e8f3fff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847949:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecf0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1e8f3fff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847954:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701662c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:3.0:1790779394.847957:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecf0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1e8f3fff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847963:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecf0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1e8f3fff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847972:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x1e8f3fff (ffff9b7703b30400) 00010000:00010000:3.0:1790779394.847975:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790779394.847984:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecf0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1e8f3fff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.847991:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ecf0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1e8f3fff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779394.848116:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+30:18738:x1877767642844160:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 659us (1103us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790779394.848124:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 54 00000100:00100000:1.0:1790779394.852628:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779394.852785:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642844288 00000100:00100000:0.0:1790779394.852798:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642844288 00000100:00100000:0.0:1790779394.852907:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:0.0:1790779394.852931:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+30:18738:x1877767642844288:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779394.852960:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779394.852992:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768c00/0xb1aa4014e936ecf7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425eb1 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.853042:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768e00/0xb1aa4014e936ecfe lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.853060:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768e00/0xb1aa4014e936ecfe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.853074:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768e00/0xb1aa4014e936ecfe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.853246:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768c00/0xb1aa4014e936ecf7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eb1 expref: 32 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.853266:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768e00/0xb1aa4014e936ecfe lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eb1 expref: 31 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.853276:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603618b00) 00010000:00010000:0.0:1790779394.853279:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790779394.853284:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718768e00, rc 0) 00000100:00100000:0.0:1790779394.853362:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+31:18738:x1877767642844288:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 445us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779394.853369:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 55 00000100:00100000:1.0:1790779394.857853:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779394.859671:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642844544 00000100:00100000:3.0:1790779394.859693:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642844544 00000100:00100000:3.0:1790779394.861018:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:3.0:1790779394.861044:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+31:18738:x1877767642844544:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790779394.861162:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.861185:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.861199:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790779394.861430:0:22711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:3.0:1790779394.861441:0:22711:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 712868561042ns, next at 713868557589ns, rc = 0 00000004:00010000:3.0:1790779394.861505:0:22711:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001f81b457 reply state 000000004e882082 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.861519:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.861527:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603618b00) 00010000:00010000:3.0:1790779394.861547:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790779394.861553:0:22711:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790779394.861681:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+33:18738:x1877767642844544:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 648us (3847us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1790779394.861689:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 56 00000100:00100000:0.0:1790779394.872733:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.873201:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642844672 00000100:00100000:2.0:1790779394.873215:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642844672 00000100:00100000:2.0:1790779394.873292:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:2.0:1790779394.873303:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+33:18738:x1877767642844672:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779394.873335:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779394.873360:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ed0c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425eb8 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.873431:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ed0c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eb8 expref: 34 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.873449:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ed0c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eb8 expref: 34 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.873559:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603618b00) 00010000:00010000:2.0:1790779394.873564:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790779394.873584:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3400, rc 0) 00000100:00100000:2.0:1790779394.873706:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+34:18738:x1877767642844672:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 404us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779394.873716:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 57 00000100:00100000:1.0:1790779394.885679:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.885799:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642844800 00000100:00100000:2.0:1790779394.885813:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642844800 00000100:00080000:3.0:1790779394.886056:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779394.886155:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1790779394.886169:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2400:x1877767642844800:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790779394.886656:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2400:x1877767642844800:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 489us (990us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1790779394.886665:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:1.0:1790779394.895985:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.896089:0:22715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642845056 00000100:00100000:2.0:1790779394.896102:0:22715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642845056 00000100:00100000:2.0:1790779394.896174:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:2.0:1790779394.896185:0:22715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+34:18738:x1877767642845056:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790779394.896638:0:22715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+35:18738:x1877767642845056:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 453us (665us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1790779394.896648:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:0.0:1790779394.915236:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.915358:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642845312 00000100:00100000:2.0:1790779394.915372:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642845312 00000100:00100000:2.0:1790779394.915451:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:2.0:1790779394.915464:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773b769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+35:18738:x1877767642845312:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790779394.915665:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773b769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+35:18738:x1877767642845312:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 203us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779394.915675:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:1.0:1790779394.918226:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779394.918322:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642845440 00000100:00100000:0.0:1790779394.918334:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642845440 00000100:00100000:0.0:1790779394.918402:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:0.0:1790779394.918414:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+35:18738:x1877767642845440:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790779394.918444:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790779394.918471:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936ed13 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ebf expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.918559:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936ed1a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.918578:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936ed1a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.918608:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936ed1a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790779394.918669:0:22712:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790779394.918693:0:22712:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936ed1a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.918724:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769600/0xb1aa4014e936ed13 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ebf expref: 37 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.918744:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936ed1a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ebf expref: 36 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.918754:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603618b00) 00010000:00010000:0.0:1790779394.918757:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790779394.918761:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7718769e00, rc 0) 00000100:00100000:0.0:1790779394.918872:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+36:18738:x1877767642845440:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 451us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779394.918914:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:1.0:1790779394.923335:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.923426:0:24216:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642845568 00000100:00100000:2.0:1790779394.923440:0:24216:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642845568 00000100:00100000:2.0:1790779394.923527:0:24216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1790779394.923538:0:24216:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+6:2401:x1877767642845568:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790779394.923562:0:24216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790779394.923589:0:24216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936ed21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ec6 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790779394.923622:0:24216:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd2002, blocks: 0x0 00010000:00010000:2.0:1790779394.923648:0:24216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=712s v=(0 0) 00010000:00010000:2.0:1790779394.923654:0:24216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779394.923665:0:24216:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936ed21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ec6 expref: 7 pid: 24216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.923689:0:24216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936ed21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ec6 expref: 7 pid: 24216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.923705:0:24216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b76039a3200, rc 0) 00000100:00100000:2.0:1790779394.923782:0:24216:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:2401:x1877767642845568:12345-192.168.203.3@tcp:101:lhsmtool_posix.0 Request processed in 246us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779394.923790:0:24216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:1.0:1790779394.929335:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.929601:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642845824 00000100:00100000:2.0:1790779394.929615:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642845824 00000100:00100000:2.0:1790779394.929688:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:2.0:1790779394.929699:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+36:18738:x1877767642845824:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790779394.930607:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+36:18738:x1877767642845824:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 900us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779394.930639:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:1.0:1790779394.945115:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779394.945576:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642845952 00000100:00100000:0.0:1790779394.945589:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642845952 00000100:00100000:0.0:1790779394.945673:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:0.0:1790779394.945686:0:22712:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+36:18738:x1877767642845952:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790779394.950161:0:22691:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:1.0:1790779394.950177:0:22691:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1790779394.950242:0:22691:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1790779394.950282:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950302:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950331:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950339:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7e00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779394.950345:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950355:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950374:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9b771d81aa00) 00010000:00010000:0.0:1790779394.950378:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779394.950384:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950391:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7e00/0xb1aa4014e936eb22 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950426:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950435:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950442:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779394.950448:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663916288:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1790779394.950451:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be6600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779394.950459:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779394.950535:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790779394.950537:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950553:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b771d81a900) 00010000:00010000:0.0:1790779394.950556:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779394.950559:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950566:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be6600/0xb1aa4014e936eb29 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950586:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950592:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950599:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950605:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe8400 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779394.950609:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950616:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950625:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9b7603617000) 00010000:00010000:0.0:1790779394.950627:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779394.950630:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950643:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8400/0xb1aa4014e936ec09 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950663:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950669:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950675:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950681:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779394.950684:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950690:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950698:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:0.0:1790779394.950702:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790779394.950704:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950711:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ec8e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950723:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950730:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950743:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950749:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7701663200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:0.0:1790779394.950752:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950758:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950768:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603618b00) 00010000:00010000:0.0:1790779394.950771:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790779394.950774:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.950780:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701663200/0xb1aa4014e936ed05 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.950971:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.950980:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.950988:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.950994:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe8600 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:2.0:1790779394.950998:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.951005:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.951015:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9b771d81a900) 00010000:00010000:2.0:1790779394.951017:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790779394.951020:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.951026:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8600/0xb1aa4014e936ebae lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779394.951057:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663916288 00000100:00100000:2.0:1790779394.951069:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663916288 00000100:00080000:3.0:1790779394.951147:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790779394.951155:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790779394.951169:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663916288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1790779394.951351:0:24695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790779394.951363:0:24695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1790779394.951366:0:24695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790779394.951368:0:24695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1790779394 -> 1790779394 00002000:00010000:2.0:1790779394.951371:0:24695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790779394.951463:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1877767663916288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 297us (931us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1790779394.951706:0:22712:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+15:18738:x1877767642845952:12345-192.168.203.3@tcp:44:lhsmtool_posix.0 Request processed in 6020us (6604us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779394.951716:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 61 00000100:00100000:2.0:1790779394.951973:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1790779394.952379:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b7704140e00/2, rc 0, transno 12884901892 00000100:00100000:3.0:1790779394.952391:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663916288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790779394.956599:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779394.959547:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642846080 00000100:00100000:3.0:1790779394.959568:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642846080 00000100:00100000:2.0:1790779394.959737:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:2.0:1790779394.959749:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:2400:x1877767642846080:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790779394.960016:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:2400:x1877767642846080:12345-192.168.203.3@tcp:16:lhsmtool_posix.0 Request processed in 268us (3432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779394.960034:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 23 00000100:00100000:0.0:1790779394.974732:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1790779394.974871:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642846336 00000100:00100000:3.0:1790779394.974926:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642846336 00000100:00100000:3.0:1790779394.974996:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:3.0:1790779394.975008:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+15:18738:x1877767642846336:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790779394.975091:0:22711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779394.975126:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769e00/0xb1aa4014e936ed1a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ebf expref: 15 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.975150:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603618b00) 00010000:00010000:3.0:1790779394.975156:0:22711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790779394.975196:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ed28 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.975213:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ed28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.975249:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ed28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790779394.975416:0:22711:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f7ede7c2 reply state 00000000d176328d transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ed28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.975430:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7701662c00/0xb1aa4014e936ed28 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.975437:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603618b00) 00010000:00010000:3.0:1790779394.975440:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790779394.975443:0:22711:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790779394.975585:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+16:18738:x1877767642846336:12345-192.168.203.3@tcp:36:lhsmtool_posix.0 Request processed in 578us (867us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1790779394.975593:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 62 00000100:00100000:1.0:1790779394.979012:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779394.979186:0:24218:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642846464 00000100:00100000:0.0:1790779394.979199:0:24218:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642846464 00000100:00100000:0.0:1790779394.979271:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:0.0:1790779394.979282:0:24218:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:2400:x1877767642846464:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790779394.979506:0:24218:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790779394.979511:0:24218:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1790779393 00002000:00010000:0.0:1790779394.979530:0:24218:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1790779393 00002000:00010000:0.0:1790779394.979532:0:24218:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1790779394 -> 1790779393 00002000:00010000:0.0:1790779394.979535:0:24218:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1790779394.979624:0:24218:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+8:2400:x1877767642846464:12345-192.168.203.3@tcp:2:lhsmtool_posix.0 Request processed in 342us (626us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1790779394.979632:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 24 00000100:00100000:3.0:1790779394.982048:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779394.982145:0:24695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642846592 00000100:00100000:2.0:1790779394.982160:0:24695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642846592 00000100:00100000:2.0:1790779394.982236:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1790779394.982249:0:24695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7710f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+8:2401:x1877767642846592:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790779394.982308:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000711ea329/0xb1aa4014e936ed2f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.982329:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779394.982333:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779394.982341:0:24695:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000711ea329/0xb1aa4014e936ed2f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.982358:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000711ea329/0xb1aa4014e936ed2f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.982406:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000711ea329/0xb1aa4014e936ed2f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.982415:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000711ea329/0xb1aa4014e936ed2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.982424:0:24695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000711ea329/0xb1aa4014e936ed2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.982432:0:24695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2c00 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:2.0:1790779394.982437:0:24695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000711ea329/0xb1aa4014e936ed2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.982447:0:24695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000711ea329/0xb1aa4014e936ed2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.982465:0:24695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000711ea329/0xb1aa4014e936ed2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779394.982489:0:24695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000711ea329/0xb1aa4014e936ed2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779394.982582:0:24695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7710f12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+8:2401:x1877767642846592:12345-192.168.203.3@tcp:1:lhsmtool_posix.0 Request processed in 336us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779394.982599:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 25 00000100:00100000:2.0:1790779394.987366:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779394.987490:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642846848 00000100:00100000:0.0:1790779394.987504:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642846848 00000100:00100000:0.0:1790779394.987583:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 63 00000100:00100000:0.0:1790779394.987595:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+16:18738:x1877767642846848:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790779394.987709:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.987732:0:22713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ec87 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e8e expref: 16 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.987743:0:22713:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.987817:0:22713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ec87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e8e expref: 16 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.987834:0:22713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ec87 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e8e expref: 16 pid: 25109 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779394.987850:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773e3df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1877767663916416:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779394.988000:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77344b4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790779394.997845:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779394.998216:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773e3df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1877767663916416:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779394.998276:0:22713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779394.998546:0:22697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642846976 00000100:00100000:3.0:1790779394.998557:0:22697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642846976 00010000:00010000:3.0:1790779394.998612:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ec87 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e8e expref: 17 pid: 25109 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779394.998705:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:3.0:1790779394.998717:0:22697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+17:2400:x1877767642846976:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779394.998748:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779394.998756:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ec87 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e8e expref: 17 pid: 25109 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.998770:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ec87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e8e expref: 17 pid: 25109 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.998810:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769200/0xb1aa4014e936ec87 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e8e expref: 17 pid: 25109 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.998831:0:22697:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:3.0:1790779394.998838:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eca3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e9c expref: 16 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.998850:0:22697:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.998859:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.998876:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779394.999185:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779394.999271:0:22697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+16:2400:x1877767642846976:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 554us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779394.999279:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00010000:00010000:0.0:1790779394.999348:0:22713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.999356:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.999666:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.999683:0:22713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ed0c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eb8 expref: 16 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.999693:0:22713:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.999735:0:22713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ed0c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eb8 expref: 16 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779394.999764:0:22713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ed0c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eb8 expref: 16 pid: 22713 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779394.999780:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773e3df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1877767663916544:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779394.999851:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77344b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790779395.009683:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773e3df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1877767663916544:192.168.203.3@tcp:104: 00010000:00010000:0.0:1790779395.009726:0:22713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779395.018213:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779395.021394:0:22696:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642847104 00000100:00100000:2.0:1790779395.021417:0:22696:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642847104 00010000:00010000:2.0:1790779395.021522:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ed0c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eb8 expref: 17 pid: 22713 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779395.021579:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:2.0:1790779395.021596:0:22696:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+17:2401:x1877767642847104:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790779395.021619:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790779395.021627:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ed0c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eb8 expref: 17 pid: 22713 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779395.021642:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ed0c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eb8 expref: 17 pid: 22713 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779395.021674:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b76039a3400/0xb1aa4014e936ed0c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425eb8 expref: 17 pid: 22713 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779395.021699:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603618b00) 00010000:00010000:2.0:1790779395.021705:0:22696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779395.021717:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779395.021726:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779395.021800:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790779395.022195:0:22696:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+16:2401:x1877767642847104:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 603us (3996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779395.022204:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00010000:00010000:0.0:1790779395.022578:0:22713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.022588:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790779395.022757:0:22713:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1790779395.023170:0:22713:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1790779395.023215:0:22713:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1790779395.023324:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773e3df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22713:1877767663916672:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790779395.023410:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779395.023460:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77344b4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790779395.023616:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663916672 00000100:00100000:2.0:1790779395.023626:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663916672 00000100:00100000:2.0:1790779395.023675:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790779395.023686:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773e3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22713:x1877767663916672:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790779395.023773:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773e3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22713:x1877767663916672:12345-0@lo:1000:mdt00_002.0 Request processed in 90us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779395.023792:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790779395.024291:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773e3df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22713:1877767663916672:0@lo:1000:mdt00_002.0 00000100:00080000:3.0:1790779395.024578:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1790779395.025708:0:22713:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1790779395.026346:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773e3df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22713:1877767663916800:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790779395.026428:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779395.026523:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77344b4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790779395.029232:0:22716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663916800 00000100:00100000:2.0:1790779395.029255:0:22716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663916800 00000100:00100000:2.0:1790779395.029416:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790779395.029431:0:22716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773e3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22713:x1877767663916800:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790779395.029807:0:22716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773e3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22713:x1877767663916800:12345-0@lo:1000:mdt00_002.0 Request processed in 379us (3376us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1790779395.029817:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790779395.029973:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773e3df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22713:1877767663916800:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1790779395.030055:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030067:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030077:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030084:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768200 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779395.030106:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030116:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030136:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603618b00) 00010000:00010000:1.0:1790779395.030139:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779395.030145:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030152:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718768200/0xb1aa4014e936ed3d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030192:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030198:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030204:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030209:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7736fe9800 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779395.030212:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030218:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030225:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:1.0:1790779395.030227:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790779395.030240:0:22713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eca3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e9c expref: 19 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030254:0:22713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eca3 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e9c expref: 19 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030264:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eca3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e9c expref: 19 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.030333:0:22713:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe8e00/0xb1aa4014e936eca3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425e9c expref: 19 pid: 25109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779395.030349:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7603bee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1877767663916928:192.168.203.3@tcp:105: 00000100:00100000:1.0:1790779395.030442:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b771854ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790779395.040408:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779395.040852:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7603bee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1877767663916928:192.168.203.3@tcp:105: 00010000:00010000:1.0:1790779395.040946:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.040961:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7736fe9800/0xb1aa4014e936ec9c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041008:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed44 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041039:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed44 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041054:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed44 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041090:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed44 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041097:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed44 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041104:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed44 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041111:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7603be7000 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779395.041116:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed44 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041124:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed44 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041139:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:1.0:1790779395.041143:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790779395.041147:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed44 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041154:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed44 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041165:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041172:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041178:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041191:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769c00 already unused, calling callback (ffffffffc18564f0) 00010000:00010000:1.0:1790779395.041195:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041201:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041211:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:1.0:1790779395.041213:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790779395.041216:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.041222:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769c00/0xb1aa4014e936ed36 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779395.042500:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+19:18738:x1877767642846848:12345-192.168.203.3@tcp:57:lhsmtool_posix.0 Request processed in 54894us (55135us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1790779395.042518:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 63 00000020:00080000:0.0:1790779395.042528:0:22713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1790779395.042803:0:22744:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790779395.042809:0:22744:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790779395.042835:0:22744:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1790779395.042842:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1790779395.047734:0:22714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642847232 00000100:00100000:3.0:1790779395.047759:0:22714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642847232 00000100:00100000:2.0:1790779395.049423:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:2.0:1790779395.049441:0:22714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7734354850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+19:18737:x1877767642847232:12345-192.168.203.3@tcp:49:dd.0 00000100:00100000:2.0:1790779395.049655:0:22714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7734354850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+19:18737:x1877767642847232:12345-192.168.203.3@tcp:49:dd.0 Request processed in 218us (9262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779395.049664:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:1.0:1790779395.049841:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779395.066852:0:22715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642847488 00000100:00100000:0.0:1790779395.066898:0:22715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642847488 00000100:00100000:0.0:1790779395.067008:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:0.0:1790779395.067027:0:22715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+19:18738:x1877767642847488:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790779395.067390:0:22715:0:(mdd_object.c:4180:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790779395.067459:0:22715:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1790779395.067513:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ed4b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.067534:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ed4b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.067549:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ed4b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.067558:0:22715:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ed4b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.067565:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ed4b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.067572:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ed4b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.067608:0:22715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790779395.067742:0:22715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+21:18738:x1877767642847488:12345-192.168.203.3@tcp:35:lhsmtool_posix.0 Request processed in 722us (17901us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1790779395.067751:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000020:00080000:0.0:1790779395.067758:0:22715:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790779395.071416:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790779395.071439:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ed4b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.071454:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718769400 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779395.071459:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ed4b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.071481:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ed4b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.071536:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9b7603618b00) 00010000:00010000:1.0:1790779395.071539:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790779395.071546:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ed4b lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.071553:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7718769400/0xb1aa4014e936ed4b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.071577:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779395.071579:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790779395.071581:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790779395.071992:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779395.072357:0:22711:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642847616 00000100:00100000:1.0:1790779395.072370:0:22711:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642847616 00000100:00100000:1.0:1790779395.072442:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:1.0:1790779395.072452:0:22711:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+21:18737:x1877767642847616:12345-192.168.203.3@tcp:101:dd.0 00010000:00010000:1.0:1790779395.072486:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790779395.072512:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed52 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x450b86b82b425ecd expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.072556:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936ed59 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.072574:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936ed59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.072587:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936ed59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.072725:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7000/0xb1aa4014e936ed52 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ecd expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.072748:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b7603be7800/0xb1aa4014e936ed59 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ecd expref: 22 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.072755:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9b7603617a00) 00010000:00010000:1.0:1790779395.072758:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790779395.072761:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b7603be7800, rc 0) 00000100:00100000:1.0:1790779395.072831:0:22711:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+22:18737:x1877767642847616:12345-192.168.203.3@tcp:101:dd.0 Request processed in 381us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779395.072836:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 64 00000100:00100000:3.0:1790779395.129362:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779395.129526:0:24221:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642847744 00000100:00100000:0.0:1790779395.129540:0:24221:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642847744 00000100:00100000:0.0:1790779395.129623:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 0 00000100:00100000:0.0:1790779395.129635:0:24221:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+8:2400:x1877767642847744:12345-192.168.203.3@tcp:4:dd.0 00010000:00010000:0.0:1790779395.129679:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.129720:0:24221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936ed21 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ec6 expref: 8 pid: 24216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.129730:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790779395.129735:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790779395.129741:0:24221:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.129801:0:24221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936ed21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ec6 expref: 8 pid: 24216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.129818:0:24221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936ed21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ec6 expref: 8 pid: 24216 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779395.129845:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773e3ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24221:1877767663917056:192.168.203.3@tcp:104: 00000100:00100000:0.0:1790779395.129999:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b77344b43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790779395.135395:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779395.135807:0:24223:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1790779395.135823:0:24223:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1790779395.136238:0:24223:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642847872 00000100:00100000:3.0:1790779395.136252:0:24223:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642847872 00000100:00100000:3.0:1790779395.139074:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779395.140564:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773e3ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:24221:1877767663917056:192.168.203.3@tcp:104: 00010000:00010000:1.0:1790779395.140609:0:24221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790779395.141405:0:25759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:2.0:1790779395.141426:0:25759:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+9:2400:x1877767642847872:12345-192.168.203.3@tcp:4:dd.0 00000100:00100000:3.0:1790779395.142164:0:22698:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642848000 00000100:00100000:3.0:1790779395.142176:0:22698:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642848000 00010000:00010000:3.0:1790779395.142220:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936ed21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ec6 expref: 10 pid: 24216 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779395.142266:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1790779395.142275:0:22698:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+10:2401:x1877767642848000:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790779395.142288:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790779395.142316:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936ed21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ec6 expref: 10 pid: 24216 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779395.142330:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936ed21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ec6 expref: 10 pid: 24216 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779395.142362:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ef62a31/0xb1aa4014e936ed21 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0x450b86b82b425ec6 expref: 10 pid: 24216 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779395.142382:0:22698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779395.142387:0:22698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790779395.142394:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779395.142404:0:22698:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790779395.142605:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790779395.142698:0:22698:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+9:2401:x1877767642848000:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 422us (3638us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.142706:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00010000:00010000:2.0:1790779395.143460:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008db18ad/0xb1aa4014e936ed67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779395.143611:0:25759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779395.143616:0:25759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790779395.143621:0:25759:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008db18ad/0xb1aa4014e936ed67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790779395.143635:0:25759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008db18ad/0xb1aa4014e936ed67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.144270:0:24221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.144286:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790779395.176155:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663917184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779395.176254:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.176323:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790779395.176330:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663917312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779395.176353:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.176379:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790779395.176388:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7704140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663917440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779395.176418:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.176454:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663917184 00000100:00100000:3.0:1790779395.176464:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663917184 00000100:00100000:3.0:1790779395.176522:0:24220:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663917312 00000100:00100000:3.0:1790779395.176525:0:24220:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663917312 00000100:00100000:3.0:1790779395.176544:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790779395.176555:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663917184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790779395.176595:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790779395.176648:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1877767663917184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.176657:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790779395.176677:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790779395.176684:0:24220:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663917312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790779395.176695:0:24220:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 34029248 pending 7704576 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790779395.176722:0:24220:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663917312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.176728:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790779395.176758:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663917440 00000100:00100000:3.0:1790779395.176762:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663917440 00000100:00100000:3.0:1790779395.176788:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790779395.176795:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663917440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790779395.176824:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790779395.176915:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1877767663917440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.176922:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1790779395.176939:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790779395.176944:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779395.176981:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1877767663917440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790779395.177002:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9d73c52-009d-4820-b396-7792bc096088:3652:1877767663917568:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177030:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.177060:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663918080:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177085:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.177109:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663918592:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177137:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.177156:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790779395.177161:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663917952:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177186:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.177207:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663918464:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177231:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.177261:0:22704:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663917568 00000100:00100000:3.0:1790779395.177264:0:22704:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663917568 00000100:00100000:3.0:1790779395.177293:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790779395.177301:0:22704:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+24:3652:x1877767663917568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177346:0:22704:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9d73c52-009d-4820-b396-7792bc096088+24:3652:x1877767663917568:12345-0@lo:400:kworker.0 Request processed in 46us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.177353:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790779395.177385:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663917696:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177429:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.177453:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663918208:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177476:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.177504:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663917312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790779395.177519:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7704141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1877767663917184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790779395.177533:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790779395.177538:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663917824:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177562:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.177582:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b7735c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663918336:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177604:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790779395.177624:0:22717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663917824 00000100:00100000:3.0:1790779395.177628:0:22717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663917824 00000100:00100000:3.0:1790779395.177652:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790779395.177658:0:22717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76048a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663917824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177695:0:22717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76048a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1877767663917824:12345-0@lo:400:kworker.0 Request processed in 37us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.177701:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790779395.177734:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663917952 00000100:00100000:3.0:1790779395.177737:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663917952 00000100:00100000:3.0:1790779395.177768:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790779395.177774:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663917952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177812:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1877767663917952:12345-0@lo:400:kworker.0 Request processed in 38us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.177819:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1790779395.177834:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779395.177851:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1877767663917952:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177874:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e9d73c52-009d-4820-b396-7792bc096088:3652:1877767663917568:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177929:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1877767663917824:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.177945:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663918080 00000100:00100000:3.0:1790779395.177949:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663918080 00000100:00100000:3.0:1790779395.177970:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663918592 00000100:00100000:3.0:1790779395.177972:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663918592 00000100:00080000:3.0:1790779395.177987:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790779395.177998:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663918464 00000100:00100000:3.0:1790779395.178000:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663918464 00000100:00080000:3.0:1790779395.178011:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779395.178022:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663917696 00000100:00100000:3.0:1790779395.178025:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663917696 00000100:00100000:3.0:1790779395.178034:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663918208 00000100:00100000:3.0:1790779395.178037:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663918208 00000100:00080000:3.0:1790779395.178047:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790779395.178058:0:25109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663918336 00000100:00100000:3.0:1790779395.178060:0:25109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663918336 00000100:00080000:3.0:1790779395.178072:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790779395.178086:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790779395.178092:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663918080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.178131:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1877767663918080:12345-0@lo:400:kworker.0 Request processed in 39us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.178137:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790779395.178170:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1877767663918080:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.178191:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790779395.178198:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663918592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.178232:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1877767663918592:12345-0@lo:400:kworker.0 Request processed in 36us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.178239:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1790779395.178263:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c50000 x1877767663918592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779395.178276:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1877767663918592:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.178291:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790779395.178298:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7704141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663918464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.178331:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1877767663918464:12345-0@lo:400:kworker.0 Request processed in 34us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.178337:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790779395.178357:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1877767663918464:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.178373:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790779395.178380:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76048a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663917696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.178412:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76048a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1877767663917696:12345-0@lo:400:kworker.0 Request processed in 32us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.178418:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790779395.178439:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1877767663917696:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.178457:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790779395.178463:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76048a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663918208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.178508:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76048a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1877767663918208:12345-0@lo:400:kworker.0 Request processed in 46us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.178515:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790779395.178538:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1877767663918208:0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.178555:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790779395.178561:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b76048a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663918336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790779395.178599:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b76048a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1877767663918336:12345-0@lo:400:kworker.0 Request processed in 38us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.178605:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1790779395.178627:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b7735c53100 x1877767663918336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790779411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790779395.178637:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b7735c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1877767663918336:0@lo:400:kworker.0 00000100:00100000:0.0:1790779395.179125:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790779395.179141:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b773e3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663918720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790779395.179189:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790779395.179240:0:24219:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767663918720 00000100:00100000:0.0:1790779395.179246:0:24219:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767663918720 00000100:00100000:0.0:1790779395.179278:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790779395.179286:0:24219:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773e3dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877767663918720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790779395.179313:0:24219:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 3485696 granted 34029248 pending 7704576 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790779395.179355:0:24219:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773e3dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1877767663918720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779395.179361:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790779395.179406:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b773e3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1877767663918720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790779395.253296:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779395.253537:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1790779395.253569:0:22712:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642848256 00000100:00100000:1.0:1790779395.253579:0:22712:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642848256 00000100:00080000:1.0:1790779395.253605:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790779395.254032:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642848512 00000100:00100000:1.0:1790779395.254038:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642848512 00000100:00100000:3.0:1790779395.254564:0:25109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 58 00000100:00100000:3.0:1790779395.254579:0:25109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2401:x1877767642848256:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779395.254761:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00100000:1.0:1790779395.254769:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7603befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:2401:x1877767642848512:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1790779395.254808:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+6:2401:x1877767642848512:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 40us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1790779395.254816:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 59 00000100:00080000:1.0:1790779395.254838:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790779395.255206:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1790779395.255235:0:24217:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642848768 00000100:00100000:2.0:1790779395.255241:0:24217:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642848768 00000100:00100000:2.0:1790779395.255287:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00100000:2.0:1790779395.255295:0:24217:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b7735c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2401:x1877767642848768:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779395.255416:0:24217:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7735c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2401:x1877767642848768:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 120us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779395.255423:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 19 00000100:00080000:2.0:1790779395.255446:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790779395.256893:0:25109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7603bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2401:x1877767642848256:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 2299us (3587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.256905:0:25109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 58 00000001:00080000:2.0:1790779395.259770:0:25031:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:2.0:1790779395.259790:0:25031:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00000100:00100000:0.0:1790779395.261777:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779395.261914:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779395.261942:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779395.261986:0:22713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642848640 00000100:00100000:0.0:1790779395.262001:0:22713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642848640 00000100:00100000:0.0:1790779395.262086:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00100000:0.0:1790779395.262100:0:22713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773e3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2401:x1877767642848640:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1790779395.262204:0:22713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773e3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2401:x1877767642848640:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 106us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779395.262214:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 60 00000100:00080000:0.0:1790779395.262248:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790779395.262319:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1790779395.262353:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642848384 00000100:00100000:0.0:1790779395.262358:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642848384 00000100:00100000:0.0:1790779395.262399:0:24697:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642848896 00000100:00100000:0.0:1790779395.262402:0:24697:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642848896 00000100:00100000:0.0:1790779395.262435:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00100000:0.0:1790779395.262446:0:24697:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773e3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2401:x1877767642848384:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779395.262600:0:24216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:3.0:1790779395.262621:0:24216:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b773e3df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2401:x1877767642848896:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:3.0:1790779395.262764:0:24216:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773e3df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bc9b911-71a6-4cae-bee1-5750e3e7a595+5:2401:x1877767642848896:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 151us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790779395.262772:0:24216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 21 00000100:00100000:2.0:1790779395.262947:0:22703:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877767642848128 00000100:00100000:2.0:1790779395.262956:0:22703:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877767642848128 00000100:00100000:2.0:1790779395.263010:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 166 00000100:00100000:2.0:1790779395.263018:0:22703:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9b770e6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+13:2401:x1877767642848128:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1790779395.263063:0:22703:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b770e6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:665a1626-0317-4a55-b618-c653e5716dd5+13:2401:x1877767642848128:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 47us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790779395.263087:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 166 00002000:00010000:1.0:1790779395.263457:0:25759:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1790779395.263465:0:25759:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1790779393 -> 1790779394 00002000:00010000:1.0:1790779395.263468:0:25759:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1790779393 -> 1790779394 00002000:00010000:1.0:1790779395.263470:0:25759:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1790779395.263488:0:25759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008db18ad/0xb1aa4014e936ed67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.263501:0:25759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008db18ad/0xb1aa4014e936ed67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.263510:0:25759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008db18ad/0xb1aa4014e936ed67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.263517:0:25759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b76039a2000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:1.0:1790779395.263522:0:25759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008db18ad/0xb1aa4014e936ed67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.263532:0:25759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008db18ad/0xb1aa4014e936ed67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.263551:0:25759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008db18ad/0xb1aa4014e936ed67 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790779395.263573:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008db18ad/0xb1aa4014e936ed67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790779395.263707:0:25759:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+7:2400:x1877767642847872:12345-192.168.203.3@tcp:4:dd.0 Request processed in 122222us (128259us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1790779395.263722:0:25759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1 00000100:00100000:0.0:1790779395.264299:0:24697:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b773e3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2401:x1877767642848384:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 1847us (2375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790779395.264312:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 20 00000100:00080000:1.0:1790779395.266769:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790779395.266779:0:22706:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1790779395.295903:0:25031:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:0.0:1790779395.303383:0:24221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1790779395.303411:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.303426:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.303436:0:24221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.303444:0:24221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b7718768000 already unused, calling callback (ffffffffc0c17ac0) 00010000:00010000:0.0:1790779395.303449:0:24221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.303458:0:24221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.303480:0:24221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790779395.303487:0:24221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005949bfaa/0xb1aa4014e936ed60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790779395.303611:0:24221:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9b7704143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:35f7145f-59d1-42cd-8cb7-4feb7ca20cb5+5:2400:x1877767642847744:12345-192.168.203.3@tcp:4:dd.0 Request processed in 173974us (174259us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1790779395.303623:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 0 00010000:00010000:3.0:1790779395.435005:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790779395.882036:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790779396.458542:0:25050:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790779396.804236:0:25796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1790779397.480123:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13514 lines, 13514 kept, 0 dropped, 0 bad.