00000040:00080000:3.0F:1782241468.815491:0:17085:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782241468.815516:0:17085:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782241468.815555:0:17085:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782241468.815565:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0F:1782241469.189933:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241470.212941:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782241470.727885:0:17027:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:1.0:1782241470.727911:0:17027:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890e67ffff00 refcount 2 committed 0 result 0 batchid 4294967531 00000020:00080000:1.0:1782241470.727916:0:17027:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e67fb9a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890e4133ac00 00000020:00080000:1.0:1782241470.727920:0:17027:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e67fb9b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890e6d3ebc00 00000020:00080000:1.0:1782241470.727943:0:17087:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967531 committed batchid 8 00000020:00080000:1.0:1782241470.728009:0:17087:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0F:1782241470.728052:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241470.728069:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241470.728078:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241470.728084:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310c00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241470.728090:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241470.728098:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241470.728115:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:0.0:1782241470.728118:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241470.728123:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241470.728129:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241471.236943:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241471.236966:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140081152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241471.237035:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1782241471.237126:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140081152 00000100:00100000:2.0:1782241471.237139:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140081152 00000100:00080000:3.0:1782241471.237299:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241471.237392:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782241471.237406:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140081152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241471.237439:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1782241471.237493:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140081152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241471.237500:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782241471.237577:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140081152:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1782241471.239651:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241471.393004:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241471.393057:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241471.393088:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241471.393116:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241471.393143:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120087040 00000100:00100000:3.0:1782241471.393153:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120087040 00000100:00100000:3.0:1782241471.393198:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 170 00000100:00100000:3.0:1782241471.393207:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2399:x1868815120087040:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241471.393277:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2399:x1868815120087040:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 70us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241471.393296:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 170 00000100:00100000:3.0:1782241471.393332:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120087168 00000100:00100000:3.0:1782241471.393335:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120087168 00000100:00100000:3.0:1782241471.393369:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120087296 00000100:00100000:3.0:1782241471.393372:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120087296 00000100:00100000:3.0:1782241471.393400:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 74 00000100:00100000:3.0:1782241471.393407:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+12:2399:x1868815120087168:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241471.393439:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+12:2399:x1868815120087168:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241471.393459:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 74 00000100:00100000:3.0:1782241471.393472:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 75 00000100:00100000:3.0:1782241471.393478:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120087296:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241471.393504:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120087296:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 26us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241471.393510:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 75 00000100:00080000:3.0:1782241471.393635:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782241471.393639:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241471.393782:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120087424 00000100:00100000:2.0:1782241471.393788:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120087424 00000100:00100000:2.0:1782241471.393840:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:2.0:1782241471.393847:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2399:x1868815120087424:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241471.393880:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2399:x1868815120087424:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 34us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241471.393887:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00080000:3.0:1782241471.394126:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241471.398500:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241471.398575:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120087552 00000100:00100000:2.0:1782241471.398584:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120087552 00000100:00100000:2.0:1782241471.398654:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:2.0:1782241471.398663:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2395:x1868815120087552:12345-192.168.204.58@tcp:9:kworker.0 00000020:00000080:2.0:1782241471.398696:0:18555:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ad1a 00000100:00080000:0.0:1782241471.398697:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241471.398795:0:18555:0:(import.c:65:import_set_state_nolock()) ffff890e436da800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1782241471.398855:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1782241471.403992:0:18555:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1782241471.404308:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+2:2395:x1868815120087552:12345-192.168.204.58@tcp:9:kworker.0 Request processed in 5640us (5809us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241471.404320:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:3.0:1782241471.424992:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241471.426909:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120087680 00000100:00100000:1.0:1782241471.426924:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120087680 00000100:00100000:1.0:1782241471.426997:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 76 00000100:00100000:1.0:1782241471.427008:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2398:x1868815120087680:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241471.427747:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241471.427961:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241471.427990:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241471.428016:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120087808 00000100:00100000:3.0:1782241471.428022:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120087808 00000100:00100000:3.0:1782241471.428134:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 77 00000100:00100000:3.0:1782241471.428143:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120087808:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241471.428208:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120087808:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 66us (3175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241471.428216:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 77 00000100:00100000:3.0:1782241471.428240:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120087936 00000100:00100000:3.0:1782241471.428244:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120087936 00000100:00100000:3.0:1782241471.428267:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120088064 00000100:00100000:3.0:1782241471.428270:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120088064 00000100:00100000:1.0:1782241471.428346:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2398:x1868815120087680:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 1339us (3361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241471.428354:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 76 00000100:00080000:1.0:1782241471.428374:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241471.428379:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241471.428382:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241471.428384:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241471.428396:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:1.0:1782241471.428403:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2395:x1868815120087936:12345-192.168.204.58@tcp:9:kworker.0 00000020:00000080:1.0:1782241471.428427:0:19502:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ad52 00000100:00080000:1.0:1782241471.428442:0:19502:0:(import.c:65:import_set_state_nolock()) ffff890e7c1cd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782241471.428485:0:19502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1782241471.428603:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:665bb25c-92e8-4fb6-a390-44e1dde8222e+2:2395:x1868815120087936:12345-192.168.204.58@tcp:9:kworker.0 Request processed in 200us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241471.428627:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 30 00010000:00010000:1.0:1782241471.429119:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241471.436265:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:3.0:1782241471.436296:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2395:x1868815120088064:12345-192.168.204.58@tcp:9:kworker.0 00000020:00000080:3.0:1782241471.436353:0:19173:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ad59 00000100:00080000:3.0:1782241471.436364:0:19173:0:(import.c:65:import_set_state_nolock()) ffff890e48139000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782241471.436417:0:19173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1782241471.436566:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+2:2395:x1868815120088064:12345-192.168.204.58@tcp:9:kworker.0 Request processed in 289us (8574us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241471.436575:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 31 00010000:00010000:3.0:1782241471.436608:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241471.569065:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241471.569147:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120088192 00000100:00100000:0.0:1782241471.569157:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120088192 00000100:00100000:0.0:1782241471.569221:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 74 00000100:00100000:0.0:1782241471.569231:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+12:15577:x1868815120088192:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1782241471.569354:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+12:15577:x1868815120088192:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 Request processed in 124us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241471.569377:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 74 00000100:00100000:1.0:1782241471.575239:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241471.576080:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120088320 00000100:00100000:3.0:1782241471.576092:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120088320 00000100:00100000:3.0:1782241471.576154:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 75 00000100:00100000:3.0:1782241471.576166:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:15577:x1868815120088320:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1782241471.576290:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:15577:x1868815120088320:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 Request processed in 116us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241471.576297:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 75 00000100:00100000:2.0:1782241471.586535:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241471.586609:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120088576 00000100:00100000:3.0:1782241471.586619:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120088576 00000100:00100000:3.0:1782241471.586676:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:3.0:1782241471.586686:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7795d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+12:15577:x1868815120088576:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782241471.587163:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7795d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+13:15577:x1868815120088576:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 477us (637us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1782241471.587170:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:1.0:1782241471.749437:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241471.749468:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140081408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241471.749540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241471.749623:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140081408 00000100:00100000:1.0:1782241471.749631:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140081408 00000100:00100000:1.0:1782241471.749675:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782241471.749684:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140081408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782241471.749719:0:18102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1782241471.749793:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140081408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241471.749800:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782241471.749846:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140081408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241471.750123:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241471.750135:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140081280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241471.750188:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241471.751260:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140081280 00000100:00100000:1.0:1782241471.751272:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140081280 00000100:00100000:1.0:1782241471.751331:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782241471.751340:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140081280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241471.751375:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782241471.751452:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140081280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241471.751460:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782241471.751742:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140081280:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782241472.261131:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241472.261376:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241472.261410:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140081664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241472.261513:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241472.261922:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140081792:0@lo:400:kworker.0 00000100:00100000:3.0:1782241472.261965:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241472.261994:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140082304:0@lo:400:kworker.0 00000100:00100000:3.0:1782241472.262022:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241472.262039:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140082816:0@lo:400:kworker.0 00000100:00100000:3.0:1782241472.262066:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241472.262085:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782241472.262090:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140082176:0@lo:400:kworker.0 00000100:00100000:3.0:1782241472.262173:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241472.262192:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140082688:0@lo:400:kworker.0 00000100:00100000:3.0:1782241472.262215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241472.262347:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140082816 00000100:00100000:0.0:1782241472.262358:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140082816 00000100:00100000:0.0:1782241472.262432:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140082688 00000100:00100000:0.0:1782241472.262435:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140082688 00000100:00100000:0.0:1782241472.262461:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782241472.262471:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140082816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.262545:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140082816:12345-0@lo:400:kworker.0 Request processed in 76us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241472.262552:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782241472.262571:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782241472.262577:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140082688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.262604:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140082688:12345-0@lo:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241472.262609:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782241472.262636:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140081920:0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.262663:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241472.262681:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140082432:0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.262706:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241472.262721:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140082944:0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.262741:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241472.262780:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782241472.262787:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140081536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241472.262829:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241472.262846:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140082048:0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.262868:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241472.262886:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140082560:0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.262908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241472.262933:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140082432 00000100:00100000:0.0:1782241472.262937:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140082432 00000100:00100000:0.0:1782241472.262958:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140082944 00000100:00100000:0.0:1782241472.262961:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140082944 00000100:00100000:0.0:1782241472.262974:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140082048 00000100:00100000:0.0:1782241472.262976:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140082048 00000100:00100000:0.0:1782241472.262985:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140082560 00000100:00100000:0.0:1782241472.262987:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140082560 00000100:00100000:0.0:1782241472.262999:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782241472.263022:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140082432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.263060:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140082432:12345-0@lo:400:kworker.0 Request processed in 39us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241472.263066:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782241472.263078:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782241472.263084:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140082944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.263111:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140082944:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241472.263117:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782241472.263128:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782241472.263134:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140082048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.263159:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140082048:12345-0@lo:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241472.263175:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782241472.263187:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782241472.263193:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140082560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.263221:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140082560:12345-0@lo:400:kworker.0 Request processed in 29us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241472.263226:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782241472.263290:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140082048:0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.263302:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140082560:0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.263310:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140082432:0@lo:400:kworker.0 00010000:00080000:0.0:1782241472.263322:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c316680 x1868815140082944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241472.263333:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140082944:0@lo:400:kworker.0 00010000:00080000:0.0:1782241472.263376:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48202a00 x1868815140082688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241472.263386:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140082688:0@lo:400:kworker.0 00000100:00100000:0.0:1782241472.263399:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140082816:0@lo:400:kworker.0 00000100:00100000:2.0:1782241472.263527:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140081664 00000100:00100000:2.0:1782241472.263533:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140081664 00000100:00100000:2.0:1782241472.263558:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140081536 00000100:00100000:2.0:1782241472.263561:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140081536 00000100:00100000:2.0:1782241472.263577:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782241472.263584:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140081664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782241472.263614:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241472.263663:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140081664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241472.263669:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782241472.263685:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782241472.263691:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140081536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782241472.263703:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241472.263734:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140081536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241472.263739:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782241472.263784:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140082304 00000100:00100000:2.0:1782241472.263789:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140082304 00000100:00100000:2.0:1782241472.263812:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140082176 00000100:00100000:2.0:1782241472.263816:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140082176 00000100:00100000:2.0:1782241472.263832:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140081920 00000100:00100000:2.0:1782241472.263835:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140081920 00000100:00100000:2.0:1782241472.263854:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782241472.263862:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140082304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241472.263899:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140081792 00000100:00100000:2.0:1782241472.263900:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140082304:12345-0@lo:400:kworker.0 Request processed in 39us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241472.263905:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140081792 00000100:00100000:2.0:1782241472.263910:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782241472.263938:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782241472.263946:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140082176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241472.263958:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782241472.263969:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e50599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3640:x1868815140081792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241472.263982:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140082176:12345-0@lo:400:kworker.0 Request processed in 36us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241472.263988:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782241472.264000:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782241472.264006:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140081920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241472.264049:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140081920:12345-0@lo:400:kworker.0 Request processed in 43us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241472.264056:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782241472.264097:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140081536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241472.264114:0:3637:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000100:00100000:1.0:1782241472.264116:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e50599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3640:x1868815140081792:12345-0@lo:400:kworker.0 Request processed in 149us (2149us total) trans 0 rc 0/0 00000004:00080000:2.0:1782241472.264122:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890d4793f100, transno 8589934596 00000100:00100000:1.0:1782241472.264127:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000004:00080000:2.0:1782241472.264139:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1782241472.264162:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140081920:0@lo:400:kworker.0 00000100:00100000:2.0:1782241472.264174:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241472.264181:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140083072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782241472.264211:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241472.264391:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140083072 00000100:00100000:2.0:1782241472.264395:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140083072 00000100:00100000:2.0:1782241472.264418:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782241472.264424:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140083072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782241472.264436:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1782241472.264469:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140083072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241472.264475:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782241472.264516:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140083072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241472.264529:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48200380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140082176:0@lo:400:kworker.0 00000100:00100000:1.0:1782241472.264543:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140081792:0@lo:400:kworker.0 00000100:00100000:1.0:1782241472.264555:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140082304:0@lo:400:kworker.0 00000100:00100000:1.0:1782241472.264573:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140081664:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782241472.264628:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782241472.264633:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241472.264636:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782241472.264638:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1782241472.646178:0:17800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782241473.287398:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241474.309416:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241475.333260:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782241476.118465:0:20425:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 15:04:35 (1782241475) 00000100:00100000:3.0:1782241476.360051:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1782241476.364345:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241476.364839:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140083200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241476.364959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241476.365890:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140083200 00000100:00100000:2.0:1782241476.365907:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140083200 00000100:00100000:2.0:1782241476.365999:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782241476.366013:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140083200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241476.366061:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1782241476.366152:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140083200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241476.366160:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1782241476.366252:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241476.366313:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140083200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241476.507129:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241476.507202:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241476.507262:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241476.507303:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120088960 00000100:00100000:3.0:1782241476.507326:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120088960 00000100:00100000:3.0:1782241476.507421:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120089216 00000100:00100000:3.0:1782241476.507425:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120089216 00000100:00100000:3.0:1782241476.507450:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 84 00000100:00100000:3.0:1782241476.507460:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2397:x1868815120088960:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241476.507566:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2397:x1868815120088960:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 107us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241476.507575:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 84 00000100:00100000:3.0:1782241476.507617:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 85 00000100:00100000:3.0:1782241476.507625:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2397:x1868815120089216:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241476.507656:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2397:x1868815120089216:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 32us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241476.507663:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 85 00000100:00080000:3.0:1782241476.507690:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241476.507695:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241476.508199:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120088704 00000100:00100000:1.0:1782241476.508206:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120088704 00000100:00100000:1.0:1782241476.508257:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 172 00000100:00100000:1.0:1782241476.508266:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2397:x1868815120088704:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241476.508310:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2397:x1868815120088704:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 45us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241476.508316:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 172 00000100:00100000:3.0:1782241476.517587:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241476.517655:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241476.517694:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241476.517732:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120088832 00000100:00100000:3.0:1782241476.517744:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120088832 00000100:00100000:3.0:1782241476.517846:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120089344 00000100:00100000:3.0:1782241476.517850:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120089344 00000100:00100000:3.0:1782241476.517878:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 86 00000100:00100000:3.0:1782241476.517891:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+13:2397:x1868815120088832:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241476.517998:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+13:2397:x1868815120088832:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 110us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241476.518007:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 86 00000100:00100000:3.0:1782241476.518049:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 87 00000100:00100000:3.0:1782241476.518056:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2397:x1868815120089344:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241476.518102:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2397:x1868815120089344:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 46us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241476.518109:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 87 00000100:00080000:3.0:1782241476.518145:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782241476.518151:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241476.518418:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120089088 00000100:00100000:2.0:1782241476.518424:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120089088 00000100:00100000:2.0:1782241476.518482:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00100000:2.0:1782241476.518490:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2397:x1868815120089088:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241476.518528:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2397:x1868815120089088:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 39us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241476.518535:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00080000:0.0:1782241476.519191:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241476.872091:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140083328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241476.872167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241476.872243:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140083328 00000100:00100000:0.0:1782241476.872249:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140083328 00000100:00100000:0.0:1782241476.872295:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782241476.872303:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140083328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241476.872334:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1782241476.873566:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140083456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241476.873691:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241476.873740:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140083456 00000100:00100000:1.0:1782241476.873745:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140083456 00000100:00100000:1.0:1782241476.873792:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782241476.873799:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140083456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241476.873830:0:18102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782241476.873868:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140083456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241476.873876:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782241476.873985:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140083456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241476.874247:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140083328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1943us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241476.874255:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782241476.874292:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140083328:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1782241476.875047:0:18550:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 665bb25c-92e8-4fb6-a390-44e1dde8222e 00000020:00000080:2.0:1782241476.875054:0:18550:0:(genops.c:906:class_export_put()) final put ffff890e7c1c8800/665bb25c-92e8-4fb6-a390-44e1dde8222e 00000001:00080000:2.0:1782241476.875234:0:17027:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:2.0:1782241476.875242:0:17027:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967531 batchid updated 00000020:00080000:1.0:1782241476.875494:0:17087:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000020:00080000:1.0:1782241476.875510:0:17087:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000001:00100000:2.0:1782241476.875556:0:19368:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 665bb25c-92e8-4fb6-a390-44e1dde8222e 00000020:00000080:2.0:1782241476.875560:0:19368:0:(genops.c:906:class_export_put()) final put ffff890d46714000/665bb25c-92e8-4fb6-a390-44e1dde8222e 00000001:00100000:2.0:1782241476.875567:0:19368:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000020:00000080:2.0:1782241476.875570:0:19368:0:(genops.c:906:class_export_put()) final put ffff890e436dc000/90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000020:00000080:0.0:1782241476.875666:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7c1c8800/665bb25c-92e8-4fb6-a390-44e1dde8222e for lustre-OST0000 00000020:00000080:0.0:1782241476.882475:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46714000/665bb25c-92e8-4fb6-a390-44e1dde8222e for lustre-OST0001 00000020:00000080:0.0:1782241476.882538:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e436dc000/90b92c6b-99f4-4cbe-a9f0-708a58cf844d for lustre-OST0001 00000020:00000080:0.0:1782241476.882566:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7c1cd000 for lustre-OST0000 00000020:00000080:0.0:1782241476.882571:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e48139000 for lustre-OST0001 00000020:00000080:0.0:1782241476.882575:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e436da800 for lustre-OST0001 00000100:00100000:1.0:1782241477.381963:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782241477.381989:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140083584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241477.382071:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241477.382238:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140083712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241477.382269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241477.382357:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241477.382456:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140083584 00000100:00100000:2.0:1782241477.382475:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140083584 00000100:00100000:3.0:1782241477.382509:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140083840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241477.382522:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140083712 00000100:00100000:2.0:1782241477.382525:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140083712 00000100:00100000:3.0:1782241477.382537:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241477.382540:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782241477.382549:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140083584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782241477.382573:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1782241477.382631:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140083584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241477.382638:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782241477.382653:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140083840 00000100:00100000:2.0:1782241477.382655:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140083840 00000100:00100000:2.0:1782241477.382669:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782241477.382674:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140083712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782241477.382691:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241477.382718:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140083712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241477.382723:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782241477.382733:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782241477.382739:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140083840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782241477.382747:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241477.382810:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140083840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241477.382816:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1782241477.382835:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241477.382839:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241477.382869:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140083840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241477.383217:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140083712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241477.387161:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241477.387251:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815140084096:0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.387271:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140083584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241477.387653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241477.387701:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140083968:0@lo:400:kworker.0 00000100:00100000:0.0:1782241477.387734:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241477.388086:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140084224:0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388099:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140083968 00000100:00100000:3.0:1782241477.388106:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140083968 00000100:00100000:0.0:1782241477.388117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241477.388148:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140084736:0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388154:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782241477.388173:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3638:x1868815140083968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241477.388181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241477.388199:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782241477.388218:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3638:x1868815140083968:12345-0@lo:400:kworker.0 Request processed in 57us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241477.388219:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140084352:0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388226:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1782241477.388240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241477.388256:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140084864:0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388266:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140084096 00000100:00100000:3.0:1782241477.388269:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140084096 00000100:00100000:0.0:1782241477.388275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241477.388293:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140084736 00000100:00100000:3.0:1782241477.388296:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140084736 00000100:00100000:0.0:1782241477.388298:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140084608:0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388327:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140084352 00000100:00100000:3.0:1782241477.388331:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140084352 00000100:00100000:0.0:1782241477.388331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241477.388341:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140084864 00000100:00100000:0.0:1782241477.388350:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140083968:0@lo:400:kworker.0 00000100:00100000:0.0:1782241477.388363:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241477.388368:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815140084480:0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388475:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140084864 00000100:00100000:3.0:1782241477.388504:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140084608 00000100:00100000:3.0:1782241477.388507:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140084608 00000100:00100000:3.0:1782241477.388527:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782241477.388533:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815140084096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388566:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815140084096:12345-0@lo:400:kworker.0 Request processed in 33us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241477.388572:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782241477.388585:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782241477.388590:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140084736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388625:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140084736:12345-0@lo:400:kworker.0 Request processed in 34us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241477.388631:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782241477.388642:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782241477.388647:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140084352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388672:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140084352:12345-0@lo:400:kworker.0 Request processed in 25us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241477.388677:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782241477.388689:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782241477.388693:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140084224 00000100:00100000:3.0:1782241477.388694:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140084864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241477.388697:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140084224 00000100:00100000:3.0:1782241477.388719:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140084864:12345-0@lo:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241477.388725:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782241477.388725:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782241477.388731:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140084224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388735:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782241477.388740:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815140084608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388787:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815140084608:12345-0@lo:400:kworker.0 Request processed in 45us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241477.388802:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782241477.388806:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140084224:12345-0@lo:400:kworker.0 Request processed in 65us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241477.388812:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782241477.388848:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140084352:0@lo:400:kworker.0 00010000:00080000:3.0:1782241477.388860:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c33df80 x1868815140084864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241477.388871:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140084864:0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388880:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140084224:0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.388890:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140084736:0@lo:400:kworker.0 00000100:00100000:0.0:1782241477.389002:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782241477.389034:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c33d180 x1868815140084608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241477.389043:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140084608:0@lo:400:kworker.0 00000100:00100000:0.0:1782241477.389054:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815140084096:0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.389658:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140084480 00000100:00100000:3.0:1782241477.389663:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140084480 00000100:00100000:3.0:1782241477.389709:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782241477.389716:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815140084480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241477.389791:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815140084480:12345-0@lo:400:kworker.0 Request processed in 75us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241477.389797:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782241477.391849:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815140084480:0@lo:400:kworker.0 00000100:00080000:2.0:1782241477.392734:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241477.392775:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1782241478.021109:0:17085:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782241478.021121:0:17085:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782241478.021144:0:17085:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1782241478.021161:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1782241478.404931:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241479.430184:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241480.164479:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241480.164532:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241480.164566:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241480.164591:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241480.164618:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120089856 00000100:00100000:3.0:1782241480.164627:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120089856 00000100:00100000:2.0:1782241480.164677:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120089472 00000100:00100000:2.0:1782241480.164683:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120089472 00000100:00100000:3.0:1782241480.164699:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:3.0:1782241480.164711:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2395:x1868815120089856:12345-192.168.204.58@tcp:9:umount.0 00000100:00100000:2.0:1782241480.164733:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120089600 00000100:00100000:2.0:1782241480.164737:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120089600 00000020:00000080:3.0:1782241480.164749:0:18556:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ad13 00000100:00100000:2.0:1782241480.164752:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120089984 00000020:00010000:3.0:1782241480.164782:0:18556:0:(genops.c:1942:obd_stale_export_put()) Put export ffff890d46713000: total 0 00000100:00100000:2.0:1782241480.164788:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120089984 00000100:00080000:3.0:1782241480.164803:0:18556:0:(import.c:65:import_set_state_nolock()) ffff890e436db800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782241480.164816:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:2.0:1782241480.164825:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c314a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eaa300c-78b6-4e0f-8097-bd653788406c+15:2398:x1868815120089472:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241480.164838:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782241480.165027:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:0.0:1782241480.165037:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eaa300c-78b6-4e0f-8097-bd653788406c+15:2398:x1868815120089600:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241480.165047:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241480.165057:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1acf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505516 expref: 15 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241480.165074:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241480.165138:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eaa300c-78b6-4e0f-8097-bd653788406c+14:2398:x1868815120089600:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 103us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241480.165145:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:0.0:1782241480.165171:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:0.0:1782241480.165178:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2396:x1868815120089984:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241480.165186:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241480.165196:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ad7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055cc expref: 13 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241480.165206:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241480.165232:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eaa300c-78b6-4e0f-8097-bd653788406c+12:2396:x1868815120089984:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 54us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241480.165238:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 6 00000020:00010000:0.0:1782241480.165256:0:18201:0:(genops.c:1928:obd_stale_export_get()) Get export ffff890d46713000: total 0 00010000:00010000:2.0:1782241480.165272:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e1acf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054e5 expref: 15 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241480.165289:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782241480.165299:0:18201:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff890d46713000, canceled 0 locks, left on hash table 1. 00000100:00100000:2.0:1782241480.165315:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c314a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eaa300c-78b6-4e0f-8097-bd653788406c+10:2398:x1868815120089472:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 490us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241480.165322:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 4 00002000:00010000:0.0:1782241480.165334:0:18201:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782241480.165339:0:18201:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1782241464 -> 1782241465 00002000:00010000:0.0:1782241480.165342:0:18201:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1782241464 -> 1782241465 00000100:00080000:2.0:1782241480.165344:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1782241480.165346:0:18201:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1782241480.165367:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028a456b9/0xc9959f2fb1e1b08c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056ac expref: 5 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241480.165394:0:18201:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff890d46713000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782241480.165419:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241480.165422:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241480.165424:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1782241480.166009:0:18556:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1782241480.166149:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+2:2395:x1868815120089856:12345-192.168.204.58@tcp:9:umount.0 Request processed in 1439us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241480.166158:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:3.0:1782241480.178724:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241480.178914:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120090880 00000100:00100000:0.0:1782241480.178924:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120090880 00000100:00100000:0.0:1782241480.179007:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 76 00000100:00100000:0.0:1782241480.179018:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+12:2395:x1868815120090880:12345-192.168.204.58@tcp:39:umount.0 00000020:00000080:0.0:1782241480.179069:0:17048:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ad0c 00000020:00010000:0.0:1782241480.179101:0:17048:0:(genops.c:1942:obd_stale_export_put()) Put export ffff890d47563000: total 0 00000100:00080000:0.0:1782241480.179105:0:17048:0:(import.c:65:import_set_state_nolock()) ffff890d47566800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782241480.179143:0:17048:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:0.0:1782241480.179323:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+11:2395:x1868815120090880:12345-192.168.204.58@tcp:39:umount.0 Request processed in 306us (608us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1782241480.179330:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 76 00000020:00010000:1.0:1782241480.179724:0:17035:0:(genops.c:1928:obd_stale_export_get()) Get export ffff890d47563000: total 0 00010000:00010000:1.0:1782241480.179730:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241480.179814:0:17035:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff890d47563000, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1782241480.179847:0:17035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:1.0:1782241480.179851:0:17035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241480.179860:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055e8 expref: 10 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241480.179893:0:17035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:1.0:1782241480.179896:0:17035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782241480.179900:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b031 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505689 expref: 9 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241480.179918:0:17035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890d4195bf00) 00010000:00010000:1.0:1782241480.179921:0:17035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241480.179924:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a400/0xc9959f2fb1e1adec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055da expref: 8 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241480.179939:0:17035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241480.179942:0:17035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782241480.179946:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1afd6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505674 expref: 7 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241480.179958:0:17035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241480.179961:0:17035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782241480.179964:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b09a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056b3 expref: 6 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241480.179979:0:17035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890e81803400) 00010000:00010000:1.0:1782241480.179981:0:17035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241480.179985:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031200/0xc9959f2fb1e1add0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055d3 expref: 5 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241480.180002:0:17035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:1.0:1782241480.180005:0:17035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782241480.180016:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1aeb0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505612 expref: 4 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241480.180031:0:17035:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff890d47563000, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1782241480.180044:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241480.180046:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241480.180047:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782241480.181855:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241480.190285:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241480.190382:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120091008 00000100:00100000:3.0:1782241480.190393:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120091008 00000100:00100000:3.0:1782241480.190478:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 77 00000100:00100000:3.0:1782241480.190490:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2395:x1868815120091008:12345-192.168.204.58@tcp:39:umount.0 00000020:00000080:3.0:1782241480.190535:0:17049:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ad05 00000100:00080000:3.0:1782241480.190550:0:17049:0:(import.c:65:import_set_state_nolock()) ffff890e7c192000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782241480.190582:0:17049:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1782241480.190915:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+3:2395:x1868815120091008:12345-192.168.204.58@tcp:39:umount.0 Request processed in 425us (638us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1782241480.190923:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 77 00010000:00010000:1.0:1782241480.191448:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782241480.191680:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782241480.453318:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241481.476860:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241481.476972:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241481.476996:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140084992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241481.477066:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241481.478152:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140084992 00000100:00100000:2.0:1782241481.478162:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140084992 00000100:00100000:2.0:1782241481.478251:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782241481.478261:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140084992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241481.478291:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1782241481.478376:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140084992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (1308us total) trans 0 rc 0/0 00000100:00080000:0.0:1782241481.478376:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241481.478384:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782241481.478538:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140084992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241481.628635:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241481.628687:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241481.628737:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120091136 00000100:00100000:1.0:1782241481.628747:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120091136 00000100:00100000:0.0:1782241481.628750:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241481.628834:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 174 00000100:00100000:1.0:1782241481.628846:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+10:2397:x1868815120091136:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241481.628914:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+10:2397:x1868815120091136:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241481.628923:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 174 00000100:00100000:3.0:1782241481.629102:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120091264 00000100:00100000:3.0:1782241481.629107:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120091264 00000100:00100000:3.0:1782241481.629158:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120091392 00000100:00100000:3.0:1782241481.629169:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120091392 00000100:00100000:3.0:1782241481.629194:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 94 00000100:00100000:3.0:1782241481.629202:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2397:x1868815120091264:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241481.629240:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2397:x1868815120091264:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 40us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241481.629246:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 94 00000100:00100000:3.0:1782241481.629260:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 95 00000100:00100000:3.0:1782241481.629266:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2397:x1868815120091392:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241481.629305:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2397:x1868815120091392:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 39us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241481.629311:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 95 00000100:00080000:0.0:1782241481.630022:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241481.630027:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241481.988961:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241481.988986:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140085120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241481.989058:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241481.989062:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241481.989071:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140085248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241481.989115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241481.994108:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140085120 00000100:00100000:3.0:1782241481.994124:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140085120 00000100:00100000:3.0:1782241481.994186:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140085248 00000100:00100000:3.0:1782241481.994191:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140085248 00000100:00100000:3.0:1782241481.994213:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782241481.994223:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140085120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241481.994262:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1782241481.994509:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140085120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 285us (5449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241481.994516:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782241481.994535:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782241481.994542:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140085248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782241481.994561:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1782241481.994597:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140085248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (5481us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241481.994603:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782241481.994653:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140085120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241481.995064:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140085248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241482.501507:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140085376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782241482.501602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241482.501696:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241482.502100:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140085632:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502132:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241482.502165:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140086144:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502189:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241482.502219:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140086656:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502238:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241482.502253:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782241482.502257:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140085504:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241482.502304:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140086016:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502323:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241482.502339:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815140086528:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241482.502384:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140085632 00000100:00100000:1.0:1782241482.502392:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140085632 00000100:00100000:1.0:1782241482.502436:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140086016 00000100:00100000:1.0:1782241482.502439:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140086016 00000100:00100000:1.0:1782241482.502458:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782241482.502467:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140085632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502518:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140085632:12345-0@lo:400:kworker.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241482.502525:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782241482.502540:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782241482.502546:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140086016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502585:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140086016:12345-0@lo:400:kworker.0 Request processed in 39us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241482.502591:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782241482.502628:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140085888:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502652:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241482.502666:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140086400:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502685:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241482.502700:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782241482.502706:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140085760:0@lo:400:kworker.0 00000100:00100000:0.0:1782241482.502711:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140085376 00000100:00100000:0.0:1782241482.502715:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140085376 00000100:00100000:1.0:1782241482.502726:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241482.502740:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140086272:0@lo:400:kworker.0 00000100:00100000:0.0:1782241482.502740:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782241482.502746:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140085376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241482.502783:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782241482.502791:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241482.502811:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140086144 00000100:00100000:1.0:1782241482.502815:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140086144 00000100:00100000:0.0:1782241482.502818:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140085376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241482.502824:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782241482.502834:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140086656 00000100:00100000:1.0:1782241482.502836:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140086656 00000100:00100000:0.0:1782241482.502840:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140086528 00000100:00100000:0.0:1782241482.502842:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140086528 00000100:00100000:1.0:1782241482.502848:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140086400 00000100:00100000:1.0:1782241482.502850:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140086400 00000100:00100000:0.0:1782241482.502855:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140085760 00000100:00100000:1.0:1782241482.502859:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140086272 00000100:00100000:1.0:1782241482.502861:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140086272 00000100:00100000:1.0:1782241482.502874:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782241482.502875:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140085760 00000100:00100000:1.0:1782241482.502879:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140086144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241482.502890:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782241482.502895:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815140086656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502909:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140086144:12345-0@lo:400:kworker.0 Request processed in 30us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241482.502915:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782241482.502919:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815140086656:12345-0@lo:400:kworker.0 Request processed in 24us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241482.502924:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782241482.502926:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782241482.502931:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815140086528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241482.502932:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782241482.502937:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140086400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.502959:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815140086528:12345-0@lo:400:kworker.0 Request processed in 28us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241482.502960:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140086400:12345-0@lo:400:kworker.0 Request processed in 22us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241482.502965:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782241482.503130:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140085504 00000100:00100000:3.0:1782241482.503135:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140085504 00000100:00100000:3.0:1782241482.503164:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782241482.503171:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3638:x1868815140085504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241482.503473:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140085888 00000100:00100000:2.0:1782241482.503478:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140085888 00000100:00100000:2.0:1782241482.503507:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782241482.503514:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140085888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241482.503547:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140085888:12345-0@lo:400:kworker.0 Request processed in 34us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241482.503552:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782241482.503614:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3638:x1868815140085504:12345-0@lo:400:kworker.0 Request processed in 443us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241482.503626:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782241482.503704:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140086784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241482.503728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241482.503749:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241482.503754:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140086912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241482.503802:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241482.503825:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140086784 00000100:00100000:3.0:1782241482.503829:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140086784 00000100:00100000:3.0:1782241482.503843:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140086912 00000100:00100000:3.0:1782241482.503846:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140086912 00000100:00100000:3.0:1782241482.503857:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782241482.503862:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140086784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782241482.503873:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1782241482.503903:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140086784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241482.503909:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782241482.503920:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782241482.503925:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140086912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782241482.503935:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1782241482.503959:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140086912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241482.503965:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782241482.504000:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140086912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241482.504012:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140086784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241482.504102:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782241482.504117:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782241482.504125:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140086272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.504169:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140086272:12345-0@lo:400:kworker.0 Request processed in 45us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241482.504175:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782241482.504186:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782241482.504205:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140085760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.504230:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140085760:12345-0@lo:400:kworker.0 Request processed in 38us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241482.504236:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782241482.504265:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140085504:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.504275:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140086016:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.504285:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815140086528:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.504294:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140085632:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.504304:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140086144:0@lo:400:kworker.0 00010000:00080000:1.0:1782241482.504318:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c7e6680 x1868815140086656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241482.504328:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140086656:0@lo:400:kworker.0 00000100:00080000:1.0:1782241482.504373:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782241482.504383:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241482.504386:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241482.504388:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241482.504407:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140085760:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.504417:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140086272:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.504427:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140085888:0@lo:400:kworker.0 00010000:00080000:1.0:1782241482.504436:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48835500 x1868815140086400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241482.504446:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140086400:0@lo:400:kworker.0 00000100:00100000:1.0:1782241482.504460:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140085376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241482.615205:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241482.615247:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241482.615286:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241482.615315:0:17034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120091520 00000100:00100000:1.0:1782241482.615325:0:17034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120091520 00000100:00100000:2.0:1782241482.615389:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120091776 00000100:00100000:2.0:1782241482.615398:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120091776 00000100:00100000:1.0:1782241482.615402:0:17034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120091648 00000100:00100000:1.0:1782241482.615408:0:17034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120091648 00000100:00100000:2.0:1782241482.615432:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:2.0:1782241482.615509:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eaa300c-78b6-4e0f-8097-bd653788406c+12:2397:x1868815120091520:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241482.615527:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241482.615546:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e43fada00/0xc9959f2fb1e1ad2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505555 expref: 12 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241482.615566:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241482.615620:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eaa300c-78b6-4e0f-8097-bd653788406c+11:2397:x1868815120091520:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 179us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241482.619056:0:17034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:1.0:1782241482.619095:0:17034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eaa300c-78b6-4e0f-8097-bd653788406c+11:2397:x1868815120091776:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241482.619116:0:17034:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241482.619137:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e821c2000/0xc9959f2fb1e1ad75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055c5 expref: 11 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241482.619169:0:17034:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241482.619800:0:17034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eaa300c-78b6-4e0f-8097-bd653788406c+10:2397:x1868815120091776:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 717us (4549us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241482.619811:0:17034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:1.0:1782241482.619848:0:17034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:1.0:1782241482.619855:0:17034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eaa300c-78b6-4e0f-8097-bd653788406c+9:2397:x1868815120091648:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241482.620272:0:17034:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241482.620287:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1ad36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505586 expref: 9 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241482.620300:0:17034:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241482.620323:0:17034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eaa300c-78b6-4e0f-8097-bd653788406c+8:2397:x1868815120091648:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 469us (5037us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241482.620330:0:17034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:1.0:1782241482.627558:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241482.627700:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120092032 00000100:00100000:3.0:1782241482.627723:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120092032 00000100:00100000:3.0:1782241482.628378:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 78 00000100:00100000:3.0:1782241482.628391:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2395:x1868815120092032:12345-192.168.204.58@tcp:39:umount.0 00000020:00000080:3.0:1782241482.628431:0:20238:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ad44 00000020:00010000:3.0:1782241482.628439:0:20238:0:(genops.c:1942:obd_stale_export_put()) Put export ffff890d46715800: total 0 00000100:00080000:3.0:1782241482.628443:0:20238:0:(import.c:65:import_set_state_nolock()) ffff890d46717000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782241482.628478:0:20238:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00010000:1.0:1782241482.628604:0:18201:0:(genops.c:1928:obd_stale_export_get()) Get export ffff890d46715800: total 0 00010000:00010000:1.0:1782241482.628656:0:18201:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff890d46715800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782241482.628695:0:18201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:1.0:1782241482.628698:0:18201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241482.628707:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ae00/0xc9959f2fb1e1ae39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055ef expref: 5 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241482.628732:0:18201:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff890d46715800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782241482.628742:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241482.628744:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241482.628746:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241482.628783:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:3.0:1782241482.629687:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:665bb25c-92e8-4fb6-a390-44e1dde8222e+3:2395:x1868815120092032:12345-192.168.204.58@tcp:39:umount.0 Request processed in 1295us (2201us total) trans 8589934638 rc 0/0 00000100:00100000:3.0:1782241482.629697:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 78 00000100:00100000:1.0:1782241482.638664:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241482.638987:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120092160 00000100:00100000:0.0:1782241482.638996:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120092160 00000100:00100000:0.0:1782241482.639054:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 79 00000100:00100000:0.0:1782241482.639073:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2395:x1868815120092160:12345-192.168.204.58@tcp:39:umount.0 00000020:00000080:0.0:1782241482.639116:0:17046:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ad4b 00000100:00080000:0.0:1782241482.639127:0:17046:0:(import.c:65:import_set_state_nolock()) ffff890d46711000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782241482.639200:0:17046:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1782241482.639364:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+3:2395:x1868815120092160:12345-192.168.204.58@tcp:39:umount.0 Request processed in 300us (710us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1782241482.639371:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 79 00010000:00010000:1.0:1782241482.643608:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241482.686086:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241482.686400:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120092416 00000100:00100000:3.0:1782241482.686412:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120092416 00000100:00100000:3.0:1782241482.686489:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 176 00000100:00100000:3.0:1782241482.686510:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+7:2395:x1868815120092416:12345-192.168.204.58@tcp:251:umount.0 00000020:00000080:3.0:1782241482.686560:0:17041:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ace2 00000020:00010000:3.0:1782241482.686568:0:17041:0:(genops.c:1942:obd_stale_export_put()) Put export ffff890e7c190000: total 0 00000100:00080000:3.0:1782241482.686573:0:17041:0:(import.c:65:import_set_state_nolock()) ffff890e7c193000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782241482.686646:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+3:2395:x1868815120092416:12345-192.168.204.58@tcp:251:umount.0 Request processed in 147us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241482.686653:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 176 00000020:00010000:1.0:1782241482.687089:0:17036:0:(genops.c:1928:obd_stale_export_get()) Get export ffff890e7c190000: total 0 00010000:00010000:1.0:1782241482.687149:0:17036:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff890e7c190000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1782241482.687187:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4499aa00/0xc9959f2fb1e1ace9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054de expref: 2 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241482.687202:0:17036:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff890e7c190000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1782241482.687235:0:17036:0:(genops.c:906:class_export_put()) final put ffff890e7c190000/1eaa300c-78b6-4e0f-8097-bd653788406c 00010000:00010000:1.0:1782241482.687251:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241482.687253:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241482.687255:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782241482.687570:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7c190000/1eaa300c-78b6-4e0f-8097-bd653788406c for MGS 00000020:00000080:3.0:1782241482.687605:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7c193000 for MGS 00000040:00080000:3.0:1782241482.885517:0:17800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782241483.524939:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241484.550121:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782241484.710037:0:20620:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782241484.732183:0:20620:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1782241484.732268:0:20620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.732311:0:20620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.732320:0:20620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.732327:0:20620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.732360:0:20620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782241484.732367:0:20620:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782241484.732400:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241484.732405:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782241484.732413:0:20620:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782241484.732449:0:20620:0:(import.c:65:import_set_state_nolock()) ffff890d48035000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1782241484.732541:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140087040:0@lo:39:umount.0 00000100:00100000:2.0:1782241484.732639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241484.732741:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241484.732750:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.732793:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241484.732797:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.732809:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241484.732817:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241484.732823:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241484.732825:0:17036:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1782241484.732828:0:17036:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1782241484.732859:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.732866:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241484.733029:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.733037:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241484.733134:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140087168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241484.733175:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241484.733230:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241484.733232:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241484.733234:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241484.733313:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140087040 00000100:00100000:3.0:1782241484.733322:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140087040 00000100:00100000:3.0:1782241484.733382:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782241484.733392:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1868815140087040:12345-0@lo:39:umount.0 00000020:00000080:3.0:1782241484.733427:0:17049:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a8d6 00000100:00080000:3.0:1782241484.733438:0:17049:0:(import.c:65:import_set_state_nolock()) ffff890e48dc1800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782241484.733509:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3636:x1868815140087040:12345-0@lo:39:umount.0 Request processed in 117us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241484.733517:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:3.0:1782241484.733529:0:17049:0:(genops.c:906:class_export_put()) final put ffff890e7d6df000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1782241484.733626:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48035000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1782241484.733645:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140087040:0@lo:39:umount.0 00000100:00100000:1.0:1782241484.733713:0:17034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140087168 00000100:00100000:1.0:1782241484.733718:0:17034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140087168 00000100:00100000:1.0:1782241484.733791:0:17034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241484.733800:0:17034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d41935c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3637:x1868815140087168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241484.733813:0:17034:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241484.733832:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eb200/0xc9959f2fb1e1a8ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8a5 expref: 24 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.733848:0:17034:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241484.734008:0:17034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d41935c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:3637:x1868815140087168:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241484.734016:0:17034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1782241484.734084:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241484.734100:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140087168:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1782241484.734174:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241484.734179:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782241484.734193:0:20620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782241484.735844:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d6df000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1782241484.735949:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e48dc1800 for lustre-MDT0000 00010000:00010000:3.0:1782241484.736470:0:20620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.736486:0:20620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.736494:0:20620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.736502:0:20620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.736565:0:20620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241484.736574:0:20620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.736582:0:20620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.736588:0:20620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.736596:0:20620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.736659:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241484.736668:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.736677:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1a00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241484.736681:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.736691:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241484.736700:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241484.736721:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241484.736724:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1782241484.736793:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.736800:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241484.736839:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.736847:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.736862:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241484.736866:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.736872:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241484.736875:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.736893:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241484.736900:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241484.736905:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241484.736907:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1782241484.736922:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.736935:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241484.736959:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.736968:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241484.736970:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241484.736972:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241484.736994:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140087424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241484.737099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241484.737178:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140087424 00000100:00100000:1.0:1782241484.737186:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140087424 00000100:00100000:1.0:1782241484.737244:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241484.737255:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:3639:x1868815140087424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241484.737272:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241484.737288:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f0a00/0xc9959f2fb1e1ab45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1ab3e expref: 23 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.737303:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241484.737315:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140087296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241484.737342:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:3639:x1868815140087424:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241484.737345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241484.737350:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241484.737368:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140087296 00000100:00100000:1.0:1782241484.737371:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140087296 00000100:00100000:1.0:1782241484.737396:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241484.737403:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:3638:x1868815140087296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241484.737412:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241484.737420:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1a7fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1a7f6 expref: 22 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.737438:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241484.737474:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:3638:x1868815140087296:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241484.737480:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241484.737523:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140087424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241484.737534:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140087296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241484.737779:0:20620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782241484.737786:0:20620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241484.737799:0:20620:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1782241484.737817:0:20620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.737825:0:20620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.737832:0:20620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.737839:0:20620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241484.737989:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241484.737999:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241484.738007:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43facc00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241484.738011:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241484.738032:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241484.738040:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241484.738046:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1782241484.738049:0:17036:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1782241484.738071:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241484.738077:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241484.738111:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241484.738121:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241484.738122:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241484.738124:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241484.738175:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140087552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241484.738211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241484.738462:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140087552 00000100:00100000:2.0:1782241484.738469:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140087552 00000100:00100000:2.0:1782241484.738515:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782241484.738525:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:3640:x1868815140087552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241484.738535:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241484.738548:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e1adb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1adad expref: 21 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241484.738562:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241484.738604:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:3640:x1868815140087552:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241484.738611:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782241484.738675:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140087552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241484.738850:0:20620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782241484.738857:0:20620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241484.738869:0:20620:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782241484.738877:0:20620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.739043:0:20620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.739050:0:20620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241484.739057:0:20620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.739146:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241484.739210:0:20620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782241484.739215:0:20620:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1782241484.739219:0:20620:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1782241484.739264:0:20620:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1782241484.739270:0:20620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1782241484.739275:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782241484.739283:0:20620:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1782241484.739290:0:20620:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff890d47566000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782241484.739296:0:20620:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff890e7c69f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782241484.739301:0:20620:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff890e67fe2800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782241484.739306:0:20620:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff890d47592000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782241484.739314:0:20620:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff890d46715800 665bb25c-92e8-4fb6-a390-44e1dde8222e 192.168.204.58@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1782241484.739321:0:20620:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff890d47563000 90b92c6b-99f4-4cbe-a9f0-708a58cf844d 192.168.204.58@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:2.0:1782241484.739326:0:20620:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff890d47700000) has exports, disconnecting them 00000020:00080000:2.0:1782241484.739330:0:20620:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff890d47566000), last request at 1782241482 00000020:00000080:2.0:1782241484.739351:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ab0d 00000100:00080000:2.0:1782241484.739375:0:20620:0:(import.c:65:import_set_state_nolock()) ffff890d47565000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1782241484.739403:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241484.739410:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.739418:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1800 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241484.739421:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.739429:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241484.739436:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241484.739441:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241484.739444:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1782241484.739446:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1782241484.739478:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.739485:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782241484.739534:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140087680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241484.739591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241484.739666:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140087680 00000100:00100000:0.0:1782241484.739672:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140087680 00000100:00100000:0.0:1782241484.739709:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782241484.739717:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:3637:x1868815140087680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241484.739727:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241484.739739:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1a7ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1a7e8 expref: 20 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241484.739753:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241484.739831:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.739840:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241484.739853:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241484.739855:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241484.739857:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1782241484.740031:0:20620:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890d47566000): rc 0 00000020:00000080:2.0:1782241484.740034:0:20620:0:(genops.c:906:class_export_put()) final put ffff890d47566000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1782241484.740048:0:20620:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff890e7c69f000), last request at 1782241482 00000020:00000080:2.0:1782241484.740052:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1aa73 00000100:00080000:2.0:1782241484.740058:0:20620:0:(import.c:65:import_set_state_nolock()) ffff890e7c699800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1782241484.740072:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47566000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1782241484.740120:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d47565000 for lustre-MDT0000 00000020:00080000:2.0:1782241484.740134:0:20620:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e7c69f000): rc 0 00000020:00000080:2.0:1782241484.740136:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e7c69f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1782241484.740143:0:20620:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff890e67fe2800), last request at 1782241410 00000020:00000080:2.0:1782241484.740146:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a9c4 00000100:00080000:2.0:1782241484.740150:0:20620:0:(import.c:65:import_set_state_nolock()) ffff890e67fe4800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1782241484.740159:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7c69f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1782241484.740186:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7c699800 for lustre-MDT0000 00000020:00080000:2.0:1782241484.740198:0:20620:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e67fe2800): rc 0 00000020:00000080:2.0:1782241484.740200:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e67fe2800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1782241484.740207:0:20620:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff890d47592000), last request at 1782241410 00000020:00000080:2.0:1782241484.740211:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a969 00000100:00080000:2.0:1782241484.740215:0:20620:0:(import.c:65:import_set_state_nolock()) ffff890e7c698800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1782241484.740223:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e67fe2800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1782241484.740251:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e67fe4800 for lustre-MDT0000 00000001:00000004:2.0:1782241484.740261:0:20620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:2.0:1782241484.740360:0:20620:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890d47592000): rc 0 00000004:00000080:2.0:1782241484.740368:0:20620:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa60ac7ddfae0 00000100:00080000:2.0:1782241484.740391:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1782241484.740395:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1782241484.740985:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241484.740992:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241484.740997:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782241484.741413:0:20620:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1782241484.741442:0:20620:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1782241484.741647:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782241484.741651:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1782241484.741667:0:20620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1782241484.741725:0:20620:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1782241484.741736:0:20620:0:(import.c:65:import_set_state_nolock()) ffff890e77aae000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1782241484.741743:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782241484.741745:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1782241484.741783:0:20620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1782241484.741859:0:20620:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1782241484.741869:0:20620:0:(import.c:65:import_set_state_nolock()) ffff890e67fa6000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1782241484.742012:0:20620:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff890d47700000) has no exports 00000100:00100000:1.0:1782241484.742106:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140087808:0@lo:39:umount.0 00000100:00100000:1.0:1782241484.742180:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241484.742221:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140087936:0@lo:9:umount.0 00000100:00100000:1.0:1782241484.742246:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241484.742266:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140088064:0@lo:9:umount.0 00000100:00100000:1.0:1782241484.742286:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241484.742394:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140087936 00000100:00100000:1.0:1782241484.742403:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140087936 00000100:00100000:1.0:1782241484.742467:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140088064 00000100:00100000:1.0:1782241484.742470:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140088064 00000100:00100000:1.0:1782241484.742492:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782241484.742501:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1868815140087936:12345-0@lo:9:umount.0 00000020:00000080:1.0:1782241484.742534:0:18555:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ab4c 00000100:00080000:1.0:1782241484.742557:0:18555:0:(import.c:65:import_set_state_nolock()) ffff890d46712000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782241484.742606:0:18555:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1782241484.742748:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3636:x1868815140087936:12345-0@lo:9:umount.0 Request processed in 246us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241484.742781:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782241484.742797:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782241484.742804:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1868815140088064:12345-0@lo:9:umount.0 00000020:00000080:1.0:1782241484.742816:0:18555:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ab53 00000100:00080000:1.0:1782241484.742823:0:18555:0:(import.c:65:import_set_state_nolock()) ffff890e7c191000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782241484.742864:0:18555:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1782241484.742996:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140087808 00000100:00100000:2.0:1782241484.743001:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140087808 00000100:00100000:2.0:1782241484.743052:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782241484.743059:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1868815140087808:12345-0@lo:39:umount.0 00000020:00000080:2.0:1782241484.743078:0:17053:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a9ee 00000100:00080000:2.0:1782241484.743084:0:17053:0:(import.c:65:import_set_state_nolock()) ffff890d469bc800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782241484.743105:0:17053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1782241484.743216:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3636:x1868815140087808:12345-0@lo:39:umount.0 Request processed in 157us (1036us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1782241484.743224:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782241484.743480:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3636:x1868815140088064:12345-0@lo:9:umount.0 Request processed in 676us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241484.743489:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1782241484.743513:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241484.743518:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782241484.743536:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241484.743543:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782241484.743581:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1782241484.743589:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140087808:0@lo:39:umount.0 00000100:00080000:1.0:1782241484.743605:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e77aae000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782241484.743609:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782241484.743611:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241484.743613:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140087936:0@lo:9:umount.0 00000100:00080000:1.0:1782241484.743623:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e67fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782241484.743638:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782241484.743640:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241484.743643:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140088064:0@lo:9:umount.0 00010000:00010000:1.0:1782241484.743667:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241484.744147:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:3637:x1868815140087680:12345-0@lo:103:ldlm_bl.0 Request processed in 4426us (4552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241484.744158:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782241484.744364:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140087680:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1782241484.751286:0:20620:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff890d47700000) has no exports 00000020:00000080:2.0:1782241484.825612:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a843 00000020:00000080:2.0:1782241484.825631:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e77aac800/lustre-QMT0000_UUID 00000020:01000000:2.0:1782241484.825655:0:20620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1782241484.826001:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e77aac800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1782241484.826338:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782241484.826349:0:20620:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782241484.826369:0:20620:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff890e77d9cd40) has no exports 00000020:00000080:2.0:1782241484.830531:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a83c 00000020:00000080:2.0:1782241484.830545:0:20620:0:(genops.c:906:class_export_put()) final put ffff890d45a63000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782241484.830608:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241484.830617:0:20620:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1782241484.830619:0:20620:0:(genops.c:906:class_export_put()) final put ffff890d45a60800/lustre-QMT0000_UUID 00000020:00000080:2.0:1782241484.830621:0:20620:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a60800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1782241484.830630:0:20620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1782241484.831091:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a63000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1782241485.573165:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782241485.575846:0:17027:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782241485.575855:0:17027:0:(genops.c:906:class_export_put()) final put ffff890d47592000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1782241485.575880:0:17027:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 665bb25c-92e8-4fb6-a390-44e1dde8222e 00000001:00080000:0.0:1782241485.575894:0:17027:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:0.0:1782241485.575898:0:17027:0:(genops.c:906:class_export_put()) final put ffff890d46715800/665bb25c-92e8-4fb6-a390-44e1dde8222e 00000001:00100000:0.0:1782241485.575907:0:17027:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000001:00080000:0.0:1782241485.575914:0:17027:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:0.0:1782241485.575917:0:17027:0:(genops.c:906:class_export_put()) final put ffff890d47563000/90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000020:00000080:1.0:1782241485.576033:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47592000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1782241485.576088:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46715800/665bb25c-92e8-4fb6-a390-44e1dde8222e for lustre-MDT0000 00000020:00000080:1.0:1782241485.576131:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47563000/90b92c6b-99f4-4cbe-a9f0-708a58cf844d for lustre-MDT0000 00000020:00000080:1.0:1782241485.576166:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7c698800 for lustre-MDT0000 00000020:00000080:1.0:1782241485.576172:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d46717000 for lustre-MDT0000 00000020:00000080:1.0:1782241485.576176:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d47566800 for lustre-MDT0000 00000001:00100000:0.0:1782241485.576513:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1782241485.576521:0:17780:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1782241485.576536:0:17780:0:(genops.c:906:class_export_put()) final put ffff890d469ba000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1782241485.576553:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 665bb25c-92e8-4fb6-a390-44e1dde8222e 00000001:00080000:0.0:1782241485.576558:0:17780:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1782241485.576560:0:17780:0:(genops.c:906:class_export_put()) final put ffff890d46711800/665bb25c-92e8-4fb6-a390-44e1dde8222e 00000001:00100000:0.0:1782241485.576574:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000001:00080000:0.0:1782241485.576579:0:17780:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1782241485.576581:0:17780:0:(genops.c:906:class_export_put()) final put ffff890e7c196800/90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000020:00000080:1.0:1782241485.576721:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d469ba000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1782241485.576903:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46711800/665bb25c-92e8-4fb6-a390-44e1dde8222e for lustre-MDT0001 00000020:00000080:1.0:1782241485.576933:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7c196800/90b92c6b-99f4-4cbe-a9f0-708a58cf844d for lustre-MDT0001 00000020:00000080:1.0:1782241485.576956:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d469bc800 for lustre-MDT0001 00000020:00000080:1.0:1782241485.576960:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d46711000 for lustre-MDT0001 00000020:00000080:1.0:1782241485.576963:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7c192000 for lustre-MDT0001 00000001:00100000:2.0:1782241485.579516:0:18550:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782241485.579525:0:18550:0:(genops.c:906:class_export_put()) final put ffff890d46710000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1782241485.579549:0:18550:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000020:00000080:2.0:1782241485.579551:0:18550:0:(genops.c:906:class_export_put()) final put ffff890d46713000/90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000020:00000080:0.0:1782241485.579598:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46710000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1782241485.579650:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46713000/90b92c6b-99f4-4cbe-a9f0-708a58cf844d for lustre-OST0000 00000020:00000080:0.0:1782241485.579668:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d46712000 for lustre-OST0000 00000020:00000080:0.0:1782241485.579673:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e436db800 for lustre-OST0000 00010000:00010000:1.0:1782241486.597030:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241486.599484:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140088192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241486.599557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241486.599662:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140088192 00000100:00100000:3.0:1782241486.599669:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140088192 00000100:00100000:3.0:1782241486.599733:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782241486.599743:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140088192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782241486.599791:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1782241486.599851:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140088192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241486.599859:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1782241486.599963:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241486.600056:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140088192:0@lo:13:osp-pre-0-1.0 00000020:01000000:2.0:1782241486.854040:0:20620:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d475dc120 - data ffff890e78c23d80/ffff890e7831a800 00000020:01000000:2.0:1782241486.854195:0:20620:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d48338360 - data ffff890e78c255e8/ffff890e503fe000 00000001:00000004:2.0:1782241486.861277:0:20620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:0.0:1782241486.908506:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1782241486.908515:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782241486.908531:0:20620:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff890e7c7e5f80 x1868815140087808/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1782241494 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241486.908556:0:20620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1782241486.918014:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1782241486.918022:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1782241486.918033:0:20620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782241486.918036:0:20620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1782241486.918372:0:17071:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1782241486.918378:0:17071:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1782241486.918388:0:17071:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1782241486.918906:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782241486.918910:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1782241486.918920:0:20620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782241486.918922:0:20620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1782241486.921337:0:17073:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1782241486.921346:0:17073:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1782241486.921359:0:17073:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1782241486.922579:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a80b 00000020:00000080:0.0:1782241486.922590:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e7d54a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782241486.923225:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d54a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782241486.926645:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a820 00000020:00000080:0.0:1782241486.926670:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e7d54c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1782241486.926681:0:20620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1782241486.926685:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241486.926694:0:20620:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782241486.926698:0:20620:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff890d47704d40) has no exports 00000004:01000000:0.0:1782241486.926879:0:20620:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1782241486.926889:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a882 00000020:00000080:0.0:1782241486.926893:0:20620:0:(genops.c:906:class_export_put()) final put ffff890d48034800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1782241486.926897:0:20620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1782241486.926900:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241486.926904:0:20620:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1782241486.926907:0:20620:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff890d4691b380) has no exports 00000020:00000080:0.0:1782241486.926913:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a87b 00000020:00000080:0.0:1782241486.926916:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e67fa5800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1782241486.927278:0:20620:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1782241486.927283:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782241486.927288:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1782241486.927294:0:20620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782241486.927296:0:20620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782241486.927324:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241486.927330:0:20620:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782241486.927334:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a86d 00000020:00000080:0.0:1782241486.927339:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e67fa3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1782241486.927343:0:20620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1782241486.927346:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241486.927349:0:20620:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1782241486.927351:0:20620:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff890d469199c0) has no exports 00000020:00000080:0.0:1782241486.927355:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a866 00000020:00000080:0.0:1782241486.927358:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e77aa8000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1782241486.927646:0:20620:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1782241486.927650:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1782241486.927652:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1782241486.927662:0:20620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782241486.927664:0:20620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782241486.927686:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241486.927691:0:20620:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1782241486.927701:0:20620:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1782241486.927706:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a858 00000020:00000080:0.0:1782241486.927710:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e7d54b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1782241486.927714:0:20620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1782241486.927718:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241486.927721:0:20620:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1782241486.927723:0:20620:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff890e77d98000) has no exports 00000020:00000080:0.0:1782241486.927727:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a851 00000020:00000080:0.0:1782241486.927729:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e7d548000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782241486.928534:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d54c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1782241486.928547:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d48034800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1782241486.928551:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e67fa5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782241486.928557:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e67fa6000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1782241486.928562:0:468:0:(genops.c:906:class_export_put()) final put ffff890e67fa4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782241486.928565:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e67fa4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1782241486.928569:0:468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782241486.928649:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e67fa3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1782241486.928653:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e77aa8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782241486.928666:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e77aae000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1782241486.928670:0:468:0:(genops.c:906:class_export_put()) final put ffff890d48883800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782241486.928672:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d48883800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1782241486.928675:0:468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782241486.928705:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d54b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1782241486.928710:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d548000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1782241486.928737:0:20620:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1782241486.928741:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782241486.928744:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1782241486.928748:0:20620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782241486.928806:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241486.928813:0:20620:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782241486.928833:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241486.928836:0:20620:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782241486.928839:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e7d54c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782241486.928841:0:20620:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d54c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1782241486.928844:0:20620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782241486.928895:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a827 00000020:00000080:1.0:1782241486.928901:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e7d549800/lustre-MDD0000_UUID 00000020:01000000:1.0:1782241486.928904:0:20620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1782241486.928907:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241486.928911:0:20620:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1782241486.928913:0:20620:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff890d47703380) has no exports 00000020:00000080:1.0:1782241486.928928:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241486.928931:0:20620:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1782241486.928934:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a82e 00000020:00000080:1.0:1782241486.928937:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e7d54b800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1782241486.928945:0:20620:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890d48284800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1782241486.928948:0:20620:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890d48284800 3 00000020:01000004:1.0:1782241486.928951:0:20620:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff890d48284800 from lustre-MDT0000 00000020:00000080:1.0:1782241486.928974:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241486.928992:0:20620:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1782241486.928995:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e7d54f800/lustre-MDT0000_UUID 00000020:00000080:1.0:1782241486.928997:0:20620:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d54f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1782241486.929003:0:20620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1782241486.929034:0:20620:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1782241486.929038:0:20620:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1782241486.929041:0:20620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1782241486.929044:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241486.929047:0:20620:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782241486.929054:0:20620:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff890e4360f800 f5d8e322-cb86-4bf4-a411-4939f9bbdcbb 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782241486.929059:0:20620:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff890d467419c0) has exports, disconnecting them 00000020:00080000:1.0:1782241486.929063:0:20620:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff890e4360f800), last request at 1782241396 00000020:00000080:1.0:1782241486.929078:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a7d3 00000020:00010000:1.0:1782241486.929082:0:20620:0:(genops.c:1942:obd_stale_export_put()) Put export ffff890e4360f800: total 2 00000100:00080000:1.0:1782241486.929085:0:20620:0:(import.c:65:import_set_state_nolock()) ffff890e43609800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1782241486.929099:0:20620:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e4360f800): rc 0 00000020:00080000:1.0:1782241486.929103:0:20620:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff890d467419c0) has no exports 00000020:00010000:1.0:1782241486.929113:0:17035:0:(genops.c:1928:obd_stale_export_get()) Get export ffff890e4360f800: total 2 00010000:00010000:1.0:1782241486.929117:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241486.929138:0:17035:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff890e4360f800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1782241486.929167:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f1c00/0xc9959f2fb1e1a900 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8f9 expref: 14 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929187:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e821c2200/0xc9959f2fb1e1ad98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1ad91 expref: 13 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929199:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164ca00/0xc9959f2fb1e1a90e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1a907 expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929210:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eaa00/0xc9959f2fb1e1a7e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1a7da expref: 11 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929229:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1aace lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1aac7 expref: 10 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929240:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1aa5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa57 expref: 9 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929251:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4499bc00/0xc9959f2fb1e1ad8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1ad83 expref: 8 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929262:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e1a9af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9a8 expref: 7 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929274:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779ea000/0xc9959f2fb1e1aaf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1aaf1 expref: 6 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929284:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e821c3800/0xc9959f2fb1e1ada6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1ad9f expref: 5 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929298:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e1ab37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1ab30 expref: 4 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929309:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1aa34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa2d expref: 3 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929320:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e1a8f2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8eb expref: 2 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241486.929330:0:17035:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff890e4360f800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1782241486.929345:0:17035:0:(genops.c:906:class_export_put()) final put ffff890e4360f800/f5d8e322-cb86-4bf4-a411-4939f9bbdcbb 00010000:00010000:1.0:1782241486.929350:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241486.929357:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241486.929359:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241486.929418:0:17039:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff890d45a28a00:17039] 0 exiting: rc = 1 00000100:00100000:3.0:1782241486.929856:0:17042:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff890e81410800:17042] 2 exiting: rc = 0 00000100:00100000:3.0:1782241486.929932:0:17041:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff890e45d81a00:17041] 1 exiting: rc = 0 00000020:00000080:3.0:1782241486.929968:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7d549000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1782241486.929973:0:468:0:(genops.c:906:class_export_put()) final put ffff890e77aaa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782241486.929989:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e77aaa800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1782241486.929994:0:468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782241486.930045:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d549800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1782241486.930050:0:468:0:(genops.c:906:class_export_put()) final put ffff890e7d54e800/lustre-MDD0000_UUID 00000020:00000080:3.0:1782241486.930052:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d54e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1782241486.930055:0:468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1782241486.930078:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d54b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782241486.930082:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e4360f800/f5d8e322-cb86-4bf4-a411-4939f9bbdcbb for MGS 00000020:00000080:3.0:1782241486.930104:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e43609800 for MGS 00000100:00100000:1.0:1782241486.930777:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930786:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930793:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930799:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930805:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930811:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930818:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930824:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930830:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930836:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930842:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930848:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930854:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930860:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930866:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930872:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930877:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930883:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930888:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930894:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930900:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930906:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930912:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930918:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930925:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930931:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930936:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930942:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930948:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930954:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930959:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930966:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.930994:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931000:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931006:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931012:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931018:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931024:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931030:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931036:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931042:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931049:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931056:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931062:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931068:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931074:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931080:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931086:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931092:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931097:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931103:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931109:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931115:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931121:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931127:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931133:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931139:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931145:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931151:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931835:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931846:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931852:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931858:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241486.931864:0:20620:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1782241486.938010:0:20620:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d482087e0 - data ffff890e78e89798/ffff890e7c18b400 00000020:01000000:1.0:1782241486.939053:0:20620:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d480733c0 - data ffff890e78cd3870/ffff890d478c2000 00000020:00000080:1.0:1782241486.939883:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a7b7 00000020:00000080:1.0:1782241486.939901:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e521bc000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1782241486.939912:0:20620:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890d48284800 from MGS, refs=2 00000020:01000004:1.0:1782241486.939915:0:20620:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890d48284800 2 00000020:01000004:1.0:1782241486.939918:0:20620:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff890d48284800 from MGS 00000020:00000080:1.0:1782241486.939940:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241486.939946:0:20620:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1782241486.939948:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e521b9800/MGS 00000020:00000080:1.0:1782241486.939950:0:20620:0:(genops.c:865:class_export_destroy()) destroying export ffff890e521b9800/MGS for MGS 00000020:01000000:1.0:1782241486.939955:0:20620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1782241486.940028:0:20620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1782241486.940031:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241486.940036:0:20620:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782241486.940042:0:20620:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff890d48035800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782241486.940047:0:20620:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff890e77d9b380) has exports, disconnecting them 00000020:00080000:1.0:1782241486.940052:0:20620:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff890d48035800), last request at 1782241396 00000020:00000080:1.0:1782241486.940055:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a8ba 00000020:00080000:1.0:1782241486.940062:0:20620:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890d48035800): rc 0 00000020:00000080:1.0:1782241486.940066:0:20620:0:(genops.c:906:class_export_put()) final put ffff890d48035800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1782241486.943038:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e521bc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782241486.943068:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d48035800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1782241486.972805:0:20620:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1782241486.972815:0:20620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782241486.972825:0:20620:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1782241486.972833:0:20620:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241486.972896:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d48035000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1782241486.973074:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241486.973084:0:20620:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1782241486.973090:0:20620:0:(genops.c:906:class_export_put()) final put ffff890d48037800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1782241486.973094:0:20620:0:(genops.c:865:class_export_destroy()) destroying export ffff890d48037800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1782241486.973099:0:20620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1782241486.973417:0:20620:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890d48284800 1 00000020:00000080:1.0:1782241486.973424:0:20620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a7a9 00000020:00000080:1.0:1782241486.973430:0:20620:0:(genops.c:906:class_export_put()) final put ffff890e521b9000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1782241486.973513:0:20620:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1782241486.973527:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241486.973532:0:20620:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1782241486.973536:0:20620:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff890d477019c0) has no exports 00000020:00000080:3.0:1782241486.973675:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e521b9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782241487.052369:0:20620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241487.052383:0:20620:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1782241487.052389:0:20620:0:(genops.c:906:class_export_put()) final put ffff890d48282800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782241487.052394:0:20620:0:(genops.c:865:class_export_destroy()) destroying export ffff890d48282800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1782241487.052407:0:20620:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1782241487.052524:0:20620:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff890d48281000 00000020:02000400:3.0:1782241487.052584:0:20620:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1782241487.120492:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140088320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241487.120568:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241487.120658:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140088320 00000100:00100000:0.0:1782241487.120666:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140088320 00000100:00100000:0.0:1782241487.120713:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782241487.120721:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1868815140088320:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1782241487.120738:0:18102:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1782241487.120815:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1868815140088320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (245us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782241487.120825:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:02020000:2.0:1782241487.120872:0:3639:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1782241487.131899:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1782241487.131912:0:3639:0:(import.c:65:import_set_state_nolock()) ffff890e42fa4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1782241487.131918:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1782241487.156280:0:3639:0:(import.c:65:import_set_state_nolock()) ffff890e42fa4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241487.156303:0:3639:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1782241487.156317:0:3639:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff890e42fa4000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241487.156378:0:3639:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7c7e5f80 x1868815140088448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241487.156531:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140088448:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1782241487.156608:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241487.156706:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140088448 00000100:00100000:3.0:1782241487.156715:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140088448 00000100:00100000:3.0:1782241487.156788:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782241487.156797:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140088448:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1782241487.156820:0:17052:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782241487.180029:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140088448:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 23225us (23414us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782241487.180043:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1782241487.180148:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e42fa4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241487.180164:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782241487.180167:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140088448:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1782241487.624268:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140088704:0@lo:400:kworker.0 00000100:00100000:3.0:1782241487.624366:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241487.624403:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140089216:0@lo:400:kworker.0 00000100:00100000:3.0:1782241487.624430:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241487.624457:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782241487.624462:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140088832:0@lo:400:kworker.0 00000100:00100000:3.0:1782241487.624483:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241487.624502:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815140089344:0@lo:400:kworker.0 00000100:00100000:3.0:1782241487.624539:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241487.624577:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140089216 00000100:00100000:3.0:1782241487.624586:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140089216 00000100:00100000:3.0:1782241487.624650:0:20238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140089344 00000100:00100000:3.0:1782241487.624653:0:20238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140089344 00000100:00100000:3.0:1782241487.624674:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782241487.624686:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140089216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241487.624748:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140089216:12345-0@lo:400:kworker.0 Request processed in 64us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241487.624787:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782241487.624808:0:20238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782241487.624813:0:20238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1868815140089344:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1782241487.624820:0:20238:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1782241487.624847:0:20238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1868815140089344:12345-0@lo:400:kworker.0 Request processed in 32us (307us total) trans 0 rc -107/-107 00000100:00100000:3.0:1782241487.624853:0:20238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782241487.625043:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140088576:0@lo:400:kworker.0 00000400:00000100:0.0:1782241487.625075:0:3640:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868815140088576 offset 0 length 224: 4 00000100:00100000:0.0:1782241487.625102:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140089088:0@lo:400:kworker.0 00000100:00100000:0.0:1782241487.625151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241487.625175:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782241487.625181:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140088960:0@lo:400:kworker.0 00000100:00100000:0.0:1782241487.625202:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241487.625347:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241487.625365:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140089600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241487.625400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241487.625547:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140088704 00000100:00100000:3.0:1782241487.625553:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140088704 00000100:00100000:0.0:1782241487.625708:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140089472:0@lo:400:kworker.0 00000100:00100000:0.0:1782241487.625735:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241487.625775:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140089088 00000100:00100000:0.0:1782241487.625778:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140089088 00000100:00100000:0.0:1782241487.625797:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140088960 00000100:00100000:0.0:1782241487.625799:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140088960 00000100:00100000:0.0:1782241487.625807:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140089472 00000100:00100000:0.0:1782241487.625809:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140089472 00000100:00100000:0.0:1782241487.625829:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782241487.625837:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140089472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241487.626007:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140089472:12345-0@lo:400:kworker.0 Request processed in 169us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241487.626015:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782241487.626033:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782241487.626038:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1868815140089088:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1782241487.626043:0:17046:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1782241487.626067:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1868815140089088:12345-0@lo:400:kworker.0 Request processed in 28us (928us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782241487.626073:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782241487.626085:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782241487.626088:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1868815140088960:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1782241487.626093:0:17046:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1782241487.626114:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1868815140088960:12345-0@lo:400:kworker.0 Request processed in 24us (911us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782241487.626128:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1782241487.626234:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1782241487.626241:0:3640:0:(import.c:65:import_set_state_nolock()) ffff890d480ce000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1782241487.626245:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1782241487.626251:0:3640:0:(import.c:65:import_set_state_nolock()) ffff890d480ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241487.626255:0:3640:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1782241487.626262:0:3640:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff890d480ce000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241487.626289:0:3640:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4881d500 x1868815140089728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241487.626312:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140088960:0@lo:400:kworker.0 00010000:00080000:0.0:1782241487.626327:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d637100 x1868815140089472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241487.626338:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140089472:0@lo:400:kworker.0 00000100:00080000:0.0:1782241487.626349:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1782241487.626352:0:3640:0:(import.c:65:import_set_state_nolock()) ffff890e4548d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1782241487.626355:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1782241487.626358:0:3640:0:(import.c:65:import_set_state_nolock()) ffff890e4548d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241487.626361:0:3640:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 487 00000100:00080000:0.0:1782241487.626366:0:3640:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff890e4548d800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241487.626378:0:3640:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4881f800 x1868815140089856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241487.626388:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140089088:0@lo:400:kworker.0 00000100:00100000:0.0:1782241487.626443:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815140089728:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1782241487.626473:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241487.626491:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140089856:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1782241487.626509:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241487.626535:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140089728 00000100:00100000:0.0:1782241487.626539:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140089728 00000100:00100000:0.0:1782241487.626553:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140089856 00000100:00100000:0.0:1782241487.626555:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140089856 00000100:00100000:0.0:1782241487.626564:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782241487.626569:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815140089728:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1782241487.626590:0:17048:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782241487.626621:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815140089728:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 50us (148us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782241487.626627:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782241487.626640:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782241487.626643:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815140089856:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1782241487.626651:0:17048:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782241487.626673:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815140089856:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 28us (162us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782241487.626679:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1782241487.626701:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d480ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241487.626706:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782241487.626709:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815140089728:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1782241487.626717:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e4548d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241487.626720:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782241487.626730:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140089856:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1782241487.627369:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241487.629000:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140088832 00000100:00100000:3.0:1782241487.629015:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140088832 00000100:00100000:1.0:1782241487.629047:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140089600 00000100:00100000:1.0:1782241487.629054:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140089600 00000100:00100000:1.0:1782241487.629111:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782241487.629121:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1868815140089600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241487.629229:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782241487.629325:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1868815140089600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 204us (3923us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241487.629333:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241487.629347:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782241487.629361:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140088704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241487.629367:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1782241487.629371:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241487.629377:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241487.629380:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140088832:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782241487.629414:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1782241487.629421:0:3637:0:(import.c:65:import_set_state_nolock()) ffff890e7d6de800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1782241487.629423:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140088704:12345-0@lo:400:kworker.0 Request processed in 66us (5056us total) trans 0 rc 0/0 00000100:02000400:1.0:1782241487.629428:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1782241487.629432:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140088832:12345-0@lo:400:kworker.0 Request processed in 54us (4946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241487.629438:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1782241487.629438:0:3637:0:(import.c:65:import_set_state_nolock()) ffff890e7d6de800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1782241487.629452:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1782241487.629452:0:3637:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 502 00000100:00080000:1.0:1782241487.629460:0:3637:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff890e7d6de800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241487.629496:0:3637:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4803b480 x1868815140089984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782241487.629509:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140089600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241487.629523:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815140089344:0@lo:400:kworker.0 00000100:00100000:1.0:1782241487.629539:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140088704:0@lo:400:kworker.0 00010000:00080000:1.0:1782241487.629563:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d635c00 x1868815140089216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241487.629572:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140089216:0@lo:400:kworker.0 00000100:00100000:1.0:1782241487.629606:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140088832:0@lo:400:kworker.0 00000100:00100000:3.0:1782241487.629664:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140089984:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1782241487.629712:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241487.630071:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140089984 00000100:00100000:1.0:1782241487.630077:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140089984 00000100:00100000:1.0:1782241487.630114:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782241487.630121:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815140089984:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1782241487.630141:0:17048:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782241487.630487:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815140089984:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 364us (775us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782241487.630495:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1782241487.630699:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d6de800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782241487.630705:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782241487.630708:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140089984:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1782241488.645982:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241489.680566:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241490.697302:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782241490.712565:0:19368:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782241490.712579:0:19368:0:(genops.c:906:class_export_put()) final put ffff890e7c197800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782241490.712876:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7c197800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1782241490.713046:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7c191000 for lustre-OST0001 00000020:01000004:0.0:1782241490.769742:0:20821:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1782241490.793347:0:20821:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1782241490.793436:0:20821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.793455:0:20821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.793464:0:20821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.793471:0:20821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.793501:0:20821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782241490.793508:0:20821:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1782241490.793543:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782241490.793549:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782241490.793557:0:20821:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782241490.793565:0:20821:0:(import.c:65:import_set_state_nolock()) ffff890d480ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1782241490.793571:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782241490.793573:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782241490.793577:0:20821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782241490.793799:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241490.793812:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241490.793823:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164dc00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241490.793828:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241490.793850:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241490.793859:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241490.793892:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241490.793895:0:17036:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1782241490.793898:0:17036:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1782241490.793966:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241490.793974:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241490.794018:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241490.794027:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241490.794042:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241490.794044:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241490.794046:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241490.794098:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241490.794132:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140090112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241490.794246:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241490.794405:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140090112 00000100:00100000:1.0:1782241490.794415:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140090112 00000100:00100000:1.0:1782241490.794476:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782241490.794487:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3638:x1868815140090112:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1782241490.794496:0:17033:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782241490 with bad export cookie 14525691200350037971 00010000:00010000:0.0:1782241490.794719:0:20821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.794730:0:20821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.794752:0:20821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.794838:0:20821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.794897:0:20821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241490.794914:0:20821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.794922:0:20821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.794929:0:20821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.794936:0:20821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241490.795100:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782241490.795108:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241490.795117:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241490.795120:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241490.795129:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241490.795147:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241490.795153:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782241490.795156:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1782241490.795183:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241490.795190:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241490.795219:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241490.795226:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241490.795241:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241490.795244:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241490.795250:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241490.795253:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241490.795259:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241490.795264:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241490.795269:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1782241490.795277:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1782241490.795291:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241490.795297:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241490.795316:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241490.795324:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241490.795326:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241490.795328:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241490.795346:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140090368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241490.795400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241490.795458:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241490.795466:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140090240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241490.795494:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241490.795521:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140090368 00000100:00100000:2.0:1782241490.795527:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140090368 00000100:00100000:2.0:1782241490.795553:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140090240 00000100:00100000:2.0:1782241490.795556:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140090240 00000100:00100000:2.0:1782241490.795571:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241490.795576:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3639:x1868815140090368:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1782241490.795582:0:17032:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782241490 with bad export cookie 14525691200350037971 00000100:00100000:2.0:1782241490.795631:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3639:x1868815140090368:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (230us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782241490.795639:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241490.795658:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782241490.795662:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d41937450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1868815140090240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1782241490.795666:0:17032:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782241490 with bad export cookie 14525691200350037971 00000100:00100000:2.0:1782241490.795704:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d41937450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1868815140090240:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (210us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782241490.795711:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1782241490.795747:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.158@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1782241490.795752:0:3637:0:(import.c:65:import_set_state_nolock()) ffff890d48881000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1782241490.795795:0:3637:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1782241490.795860:0:20821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782241490.795865:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241490.795867:0:20821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241490.795889:0:20821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1782241490.795910:0:20821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.795918:0:20821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.795932:0:20821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.795939:0:20821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.796198:0:20821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241490.796208:0:20821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.796216:0:20821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.796222:0:20821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241490.796228:0:20821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241490.796997:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241490.797008:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241490.797018:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c3200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241490.797021:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241490.797031:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241490.797038:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241490.797044:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782241490.797048:0:17036:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782241490.797050:0:17036:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782241490.797233:0:20821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782241490.797241:0:20821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1782241490.797245:0:20821:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1782241490.797342:0:20821:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1782241490.797347:0:20821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1782241490.797354:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241490.797361:0:20821:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1782241490.797367:0:20821:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff890e77a73000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782241490.797374:0:20821:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff890d47b78800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782241490.797393:0:20821:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff890e81fcb380) has exports, disconnecting them 00000020:00080000:0.0:1782241490.797398:0:20821:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff890e77a73000), last request at 1782241487 00000020:00000080:0.0:1782241490.797407:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ab22 00000100:00080000:0.0:1782241490.797506:0:20821:0:(import.c:65:import_set_state_nolock()) ffff890e67fe3800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1782241490.797574:0:20821:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e77a73000): rc 0 00000020:00000080:0.0:1782241490.797577:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e77a73000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1782241490.797647:0:20821:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff890d47b78800), last request at 1782241487 00000020:00000080:0.0:1782241490.797651:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1aa88 00000100:00080000:0.0:1782241490.797656:0:20821:0:(import.c:65:import_set_state_nolock()) ffff890d47b7b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1782241490.797663:0:20821:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890d47b78800): rc 0 00000020:00000080:0.0:1782241490.797665:0:20821:0:(genops.c:906:class_export_put()) final put ffff890d47b78800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1782241490.797673:0:20821:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa60ac14c3ae0 00000100:00080000:0.0:1782241490.797700:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782241490.797709:0:20821:0:(client.c:3600:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff890d48201c00 x1868815140088320/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1782241503 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241490.797722:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782241490.799473:0:20821:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782241490.799487:0:20821:0:(import.c:65:import_set_state_nolock()) ffff890e42fa4000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1782241490.803067:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.158@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1782241490.810398:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241490.810413:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241490.810425:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241490.810430:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241490.810469:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241490.810477:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241490.810483:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241490.810485:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1782241490.810489:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:2.0:1782241490.831053:0:3637:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.158@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1782241490.831062:0:3637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1782241490.831076:0:3637:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7d634700 x1868815140088576/t0(0) o400->MGC192.168.204.158@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1782241503 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241490.831284:0:3637:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d48039500 x1868815140090112/t0(0) o103->MGC192.168.204.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782241506 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241490.831305:0:3637:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7f685f80 x1868815140090368/t0(0) o103->MGC192.168.204.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782241506 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241490.831316:0:3637:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7c7e5f80 x1868815140090240/t0(0) o103->MGC192.168.204.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782241506 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1782241490.831384:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1782241490.831388:0:3637:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1782241490.831390:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1782241490.836724:0:3639:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff890d48881000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1782241490.836753:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140088320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241490.837135:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140090368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241490.838220:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3638:x1868815140090112:12345-0@lo:103:ldlm_bl.0 Request processed in 43726us (43968us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782241490.838236:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1782241490.842378:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241490.842408:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241490.842444:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241490.842452:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241490.842478:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241490.842501:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782241490.842501:0:3637:0:(import.c:65:import_set_state_nolock()) ffff890d48881000 MGS: changing import state from DISCONN to CONNECTING 00010000:00010000:3.0:1782241490.842505:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782241490.842515:0:3637:0:(import.c:512:import_select_connection()) MGC192.168.204.158@tcp: connect to NID 0@lo last attempt 459 00000100:00080000:2.0:1782241490.842526:0:3637:0:(import.c:626:import_select_connection()) MGC192.168.204.158@tcp: import ffff890d48881000 using connection 192.168.204.158@tcp/0@lo 00000020:00000080:2.0:1782241490.842545:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e77a73000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:1.0:1782241490.842722:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241490.842732:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241490.842742:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241490.842749:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241490.842782:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241490.842784:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241490.842786:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782241490.843044:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47b78800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1782241490.843077:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e67fe3800 for lustre-MDT0001 00000020:00000080:2.0:1782241490.843082:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d47b7b800 for lustre-MDT0001 00000100:00100000:2.0:1782241490.843111:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:0:1868815140090496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241490.843144:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140088576:0@lo:400:kworker.0 00000100:00100000:2.0:1782241490.843186:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140090112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241490.843207:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241490.843212:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:0:1868815140090624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241490.843243:0:3637:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f686d80 x1868815140090752/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782241490.843274:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3636:1868815140090752:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1782241490.843433:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868815140090752 offset 0 length 520: 4 00000100:00100000:2.0:1782241490.843540:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140090240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241490.843860:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782241490.843943:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782241490.843958:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1782241490.843984:0:20821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1782241490.846075:0:20821:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1782241490.846139:0:20821:0:(import.c:65:import_set_state_nolock()) ffff890e7c69c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1782241490.846184:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782241490.846189:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1782241490.846206:0:20821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1782241490.846263:0:20821:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1782241490.846274:0:20821:0:(import.c:65:import_set_state_nolock()) ffff890d469bc000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1782241490.846338:0:20821:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff890e81fcb380) has no exports 00000100:00100000:2.0:1782241490.846386:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140090880:0@lo:9:umount.0 00000100:00100000:2.0:1782241490.846543:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241490.846597:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140091008:0@lo:9:umount.0 00000100:00100000:2.0:1782241490.846775:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241490.846829:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140090880 00000100:00100000:2.0:1782241490.846838:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140090880 00000100:00100000:2.0:1782241490.846912:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140091008 00000100:00100000:2.0:1782241490.846915:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140091008 00000100:00100000:2.0:1782241490.846943:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782241490.846953:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1868815140090880:12345-0@lo:9:umount.0 00000020:00000080:2.0:1782241490.846988:0:18555:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1aab2 00000100:00080000:2.0:1782241490.846998:0:18555:0:(import.c:65:import_set_state_nolock()) ffff890d47b79800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782241490.847057:0:18555:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1782241490.847128:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782241490.847152:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1868815140091008:12345-0@lo:9:umount.0 00000020:00000080:0.0:1782241490.847172:0:19173:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ab5a 00000100:00080000:0.0:1782241490.847179:0:19173:0:(import.c:65:import_set_state_nolock()) ffff890e7c193800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782241490.847220:0:19173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1782241490.847351:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3636:x1868815140091008:12345-0@lo:9:umount.0 Request processed in 213us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241490.847361:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1782241490.847619:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241490.848580:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3636:x1868815140090880:12345-0@lo:9:umount.0 Request processed in 1622us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241490.848604:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1782241490.849542:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7c69c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1782241490.849680:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1782241490.850293:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782241490.850302:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140090880:0@lo:9:umount.0 00000100:00080000:2.0:1782241490.850326:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d469bc000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1782241490.850341:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1782241490.850342:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782241490.850345:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140091008:0@lo:9:umount.0 00010000:00010000:2.0:1782241490.851269:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782241490.851285:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241490.851291:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1782241490.862158:0:20821:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff890e81fcb380) has no exports 00000020:01000000:3.0:1782241490.928109:0:20821:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d48208d20 - data ffff890e421a0af8/ffff890e7c18bc00 00000020:01000000:3.0:1782241490.928263:0:20821:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d48208e40 - data ffff890e78e811b0/ffff890e780d3c00 00000001:00000004:3.0:1782241490.945922:0:20821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1782241491.007391:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241491.007404:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782241491.007426:0:20821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1782241491.011589:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782241491.011601:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1782241491.011637:0:20821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782241491.011641:0:20821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1782241491.014614:0:17788:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1782241491.014628:0:17788:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1782241491.014661:0:17788:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1782241491.015975:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782241491.015986:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1782241491.016009:0:20821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241491.016012:0:20821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1782241491.016626:0:17790:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1782241491.016632:0:17790:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1782241491.018462:0:17790:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1782241491.020614:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a91c 00000020:00000080:1.0:1782241491.020876:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e42a8f800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1782241491.021315:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e42a8f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1782241491.022163:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a931 00000020:00000080:1.0:1782241491.022176:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e5066c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1782241491.022225:0:20821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1782241491.022231:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241491.022249:0:20821:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1782241491.022254:0:20821:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff890e81fc8000) has no exports 00000004:01000000:1.0:1782241491.022541:0:20821:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1782241491.022552:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a985 00000020:00000080:1.0:1782241491.022557:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e67fe5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782241491.022805:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e5066c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1782241491.022877:0:20821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1782241491.022882:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241491.022888:0:20821:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782241491.022891:0:20821:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff890d46740000) has no exports 00000020:00000080:1.0:1782241491.022907:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a97e 00000020:00000080:1.0:1782241491.022913:0:20821:0:(genops.c:906:class_export_put()) final put ffff890d469b9800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1782241491.022932:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e67fe5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1782241491.023401:0:20821:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1782241491.023408:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782241491.023413:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1782241491.023421:0:20821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241491.023424:0:20821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241491.023501:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d469b9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1782241491.023592:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241491.023600:0:20821:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1782241491.023609:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a970 00000020:00000080:1.0:1782241491.023614:0:20821:0:(genops.c:906:class_export_put()) final put ffff890d469ba800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782241491.023825:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d469bc000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1782241491.023834:0:36:0:(genops.c:906:class_export_put()) final put ffff890d469b8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782241491.023836:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d469b8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1782241491.023843:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1782241491.024024:0:20821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1782241491.024029:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241491.024035:0:20821:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782241491.024038:0:20821:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff890e43fe99c0) has no exports 00000020:00000080:1.0:1782241491.024045:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a962 00000020:00000080:1.0:1782241491.024050:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e7c69a800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1782241491.024324:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d469ba800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1782241491.024337:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7c69a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1782241491.025020:0:20821:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1782241491.025038:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782241491.025043:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1782241491.025050:0:20821:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241491.025052:0:20821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782241491.025450:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241491.025460:0:20821:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1782241491.025483:0:20821:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1782241491.025492:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a954 00000020:00000080:1.0:1782241491.025501:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e7c69b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782241491.025525:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7c69c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1782241491.025533:0:36:0:(genops.c:906:class_export_put()) final put ffff890e7c69f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782241491.025547:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7c69f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1782241491.025559:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1782241491.026011:0:20821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1782241491.026016:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241491.026024:0:20821:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782241491.026030:0:20821:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff890e81fccd40) has no exports 00000020:00000080:1.0:1782241491.026040:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a94d 00000020:00000080:1.0:1782241491.026048:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e42fa6000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1782241491.026119:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7c69b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1782241491.027497:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e42fa6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1782241491.031980:0:20821:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1782241491.031992:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782241491.031998:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782241491.032009:0:20821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782241491.032082:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241491.032097:0:20821:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782241491.032165:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241491.032170:0:20821:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782241491.032182:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e43fd6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782241491.032218:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e42fa4000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1782241491.032228:0:36:0:(genops.c:906:class_export_put()) final put ffff890e42a8d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782241491.032232:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e42a8d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1782241491.032249:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782241491.032497:0:20821:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43fd6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1782241491.032516:0:20821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782241491.032666:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a938 00000020:00000080:0.0:1782241491.032676:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e5066d000/lustre-MDD0001_UUID 00000020:01000000:0.0:1782241491.032690:0:20821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1782241491.032694:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241491.032700:0:20821:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782241491.032704:0:20821:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff890e81fc99c0) has no exports 00000020:00000080:0.0:1782241491.032726:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241491.032729:0:20821:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1782241491.032733:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a93f 00000020:00000080:0.0:1782241491.032736:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e5066f800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1782241491.032746:0:20821:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890d48032000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1782241491.032749:0:20821:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890d48032000 2 00000020:01000004:0.0:1782241491.032753:0:20821:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff890d48032000 from lustre-MDT0001 00000020:00000080:0.0:1782241491.032798:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241491.032801:0:20821:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1782241491.032804:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e42a89000/lustre-MDT0001_UUID 00000020:00000080:0.0:1782241491.032806:0:20821:0:(genops.c:865:class_export_destroy()) destroying export ffff890e42a89000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1782241491.032814:0:20821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1782241491.032842:0:20821:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1782241491.032846:0:20821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1782241491.032848:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241491.032851:0:20821:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782241491.032859:0:20821:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff890d480ca000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782241491.032865:0:20821:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff890e43feb380) has exports, disconnecting them 00000020:00080000:0.0:1782241491.032870:0:20821:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff890d480ca000), last request at 1782241410 00000020:00000080:0.0:1782241491.032874:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a9bd 00000020:00080000:0.0:1782241491.032886:0:20821:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890d480ca000): rc 0 00000020:00000080:0.0:1782241491.032890:0:20821:0:(genops.c:906:class_export_put()) final put ffff890d480ca000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1782241491.033662:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e5066d000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1782241491.033671:0:36:0:(genops.c:906:class_export_put()) final put ffff890e42a8b000/lustre-MDD0001_UUID 00000020:00000080:3.0:1782241491.033673:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e42a8b000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1782241491.033679:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1782241491.033847:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e5066f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1782241491.033852:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d480ca000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1782241491.092861:0:20821:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1782241491.092877:0:20821:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241491.092883:0:20821:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782241491.092903:0:20821:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241491.092953:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d480ce000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1782241491.093186:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241491.093197:0:20821:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1782241491.093204:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e42a8b800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1782241491.093209:0:20821:0:(genops.c:865:class_export_destroy()) destroying export ffff890e42a8b800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1782241491.093226:0:20821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1782241491.093936:0:20821:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890d48032000 1 00000020:00000080:3.0:1782241491.093946:0:20821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a8e4 00000020:00000080:3.0:1782241491.094409:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e53bea000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1782241491.094435:0:20821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1782241491.094481:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e53bea000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1782241491.094498:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241491.094508:0:20821:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782241491.094513:0:20821:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff890e77d999c0) has no exports 00000020:00000080:0.0:1782241491.172394:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241491.172408:0:20821:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1782241491.172423:0:20821:0:(genops.c:906:class_export_put()) final put ffff890d48036000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1782241491.172428:0:20821:0:(genops.c:865:class_export_destroy()) destroying export ffff890d48036000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1782241491.172440:0:20821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1782241491.172564:0:20821:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff890d48034000 00000020:01000000:0.0:1782241491.172583:0:20821:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1782241491.172587:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241491.172591:0:20821:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782241491.172595:0:20821:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff890d46744d40) has no exports 00000100:00100000:2.0:1782241491.173051:0:17049:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff890e7c6cae00:17049] 2 exiting: rc = 0 00000100:00100000:0.0:1782241491.173673:0:19501:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff890d46651800:19501] 3 exiting: rc = 0 00000100:00100000:2.0:1782241491.173852:0:20238:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff890e78080000:20238] 4 exiting: rc = 0 00000100:00100000:1.0:1782241491.174028:0:17046:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff890e41284a00:17046] 0 exiting: rc = 1 00000100:00100000:1.0:1782241491.174173:0:17048:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff890d46b55400:17048] 1 exiting: rc = 0 00000100:00100000:0.0:1782241491.174303:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174312:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174318:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174323:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174328:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174334:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174339:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174345:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174350:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174356:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174361:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174366:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174372:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174377:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174382:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174388:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174394:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174399:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174407:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174413:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174422:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174428:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174433:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174439:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174444:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174465:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174473:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174480:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174486:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174492:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174498:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174503:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174510:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174515:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174521:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174526:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174531:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174536:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174541:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174546:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174551:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174557:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174571:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174578:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174583:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174589:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174594:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174599:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174605:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174610:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174615:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174620:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174625:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174631:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174636:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174641:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174647:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174652:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174658:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174663:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174675:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174680:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174686:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.174692:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241491.178870:0:17051:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff890e7c6cb200:17051] 1 exiting: rc = 0 00000100:00100000:1.0:1782241491.179032:0:17050:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff890e470f7200:17050] 0 exiting: rc = 1 00000100:00100000:2.0:1782241491.180169:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180178:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180184:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180191:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180197:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180203:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180209:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180214:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180219:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180224:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180229:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180234:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180239:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180245:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180250:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180255:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180261:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180280:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180285:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180291:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180296:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180303:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180308:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180313:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180318:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180323:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180329:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180334:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180339:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180345:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180350:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180356:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180360:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180366:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180371:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180376:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180381:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180387:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180392:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180398:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180403:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180410:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180415:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180421:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180426:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180431:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180437:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180443:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180448:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180453:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180458:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180463:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180477:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180485:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180490:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180495:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180500:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180506:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180512:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180517:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180522:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180527:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180533:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.180538:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.181428:0:18102:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff890e81544400:18102] 2 exiting: rc = 0 00000100:00100000:1.0:1782241491.181563:0:17053:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff890e48d8ae00:17053] 1 exiting: rc = 0 00000100:00100000:3.0:1782241491.182101:0:17052:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff890e48d8b000:17052] 0 exiting: rc = 1 00000100:00100000:2.0:1782241491.182133:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182145:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182153:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182159:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182166:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182171:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182176:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182182:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182189:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182206:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182214:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182220:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182226:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182231:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182236:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182241:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182246:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182252:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182257:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182261:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182266:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182283:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182289:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182302:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182308:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182314:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182320:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182325:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182331:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182336:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182343:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182348:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182354:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182374:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182382:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182388:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182394:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182400:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182408:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182414:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182420:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182427:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182432:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182438:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182444:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182463:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182470:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182476:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182483:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182489:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182495:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182500:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182506:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182512:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182518:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182524:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182529:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182549:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182560:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182566:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182572:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182577:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182583:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241491.182589:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241491.190693:0:17054:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff890e48d8a000:17054] 0 exiting: rc = 1 00000100:00100000:2.0:1782241491.190868:0:17055:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff890e463ee600:17055] 1 exiting: rc = 0 00000100:00100000:0.0:1782241491.191414:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191423:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191428:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191433:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191439:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191445:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191451:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191455:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191461:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191466:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191472:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191477:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191482:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191487:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191492:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191498:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191502:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191508:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191513:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191518:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191523:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191528:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191532:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191537:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191542:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191547:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191552:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191556:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191561:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191566:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191583:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191588:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191592:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191597:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191602:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191607:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191612:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191618:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191624:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191630:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191636:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191641:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191648:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191653:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191659:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191664:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191671:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191677:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191682:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191687:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191693:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191698:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191704:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191710:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191716:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191721:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191726:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191731:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191736:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191741:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191746:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191751:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191977:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.191985:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241491.192475:0:17056:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff890e463efa00:17056] 0 exiting: rc = 1 00000100:00100000:2.0:1782241491.192682:0:17057:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff890e463ef600:17057] 1 exiting: rc = 0 00000100:00100000:0.0:1782241491.192792:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192808:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192813:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192818:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192823:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192828:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192834:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192840:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192846:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192851:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192856:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192862:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192868:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192873:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192879:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192883:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192889:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192907:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192912:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192917:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192923:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192928:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192933:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192938:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192943:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192948:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192952:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192957:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192961:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192966:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192971:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192975:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192980:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192985:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192990:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.192996:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193008:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193014:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193020:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193025:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193030:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193035:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193039:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193044:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193048:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193053:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193058:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193063:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193068:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193072:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193213:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193218:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193224:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193229:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193235:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193241:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193246:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193251:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193255:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193261:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193267:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193272:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193279:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.193284:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241491.193744:0:17058:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff890e463ee800:17058] 0 exiting: rc = 1 00000100:00100000:2.0:1782241491.194019:0:17059:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff890e463ee000:17059] 1 exiting: rc = 0 00000100:00100000:0.0:1782241491.194208:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194215:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194221:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194227:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194232:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194239:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194245:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194260:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194266:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194271:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194277:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194282:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194289:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194295:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194300:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194305:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194310:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194315:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194320:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194325:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194329:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194335:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194339:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194344:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194349:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194355:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194361:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194365:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194370:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194375:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194380:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194385:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194389:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194394:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194399:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194405:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194410:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194416:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194421:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194425:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194430:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194435:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194447:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194453:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194459:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194465:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194470:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194475:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194480:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194486:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194492:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194497:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194503:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194508:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194514:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194519:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194525:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194530:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194536:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194541:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194545:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194550:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194555:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.194559:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195312:0:17061:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff890e7d6d6400:17061] 1 exiting: rc = 0 00000100:00100000:0.0:1782241491.195472:0:17062:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff890d46510800:17062] 2 exiting: rc = 0 00000100:00100000:2.0:1782241491.195728:0:17060:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff890e7d6d6e00:17060] 0 exiting: rc = 1 00000100:00100000:0.0:1782241491.195840:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195848:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195854:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195861:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195866:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195873:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195880:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195886:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195902:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195911:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195919:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195934:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195939:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195945:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195951:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195957:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195962:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195968:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195990:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.195997:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196002:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196009:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196014:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196020:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196026:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196032:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196038:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196045:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196050:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196056:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196061:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196067:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196131:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196139:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196145:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196151:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196156:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196162:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196167:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196174:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196180:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196185:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196206:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196212:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196218:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196223:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196234:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196239:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196245:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196250:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196255:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196260:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196266:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196272:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196277:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196283:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196289:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196294:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196299:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196305:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196310:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196315:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196320:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241491.196326:0:20821:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1782241491.199970:0:20821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241491.199984:0:20821:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1782241491.199989:0:20821:0:(genops.c:906:class_export_put()) final put ffff890e521b8800/MDS_uuid 00000020:00000080:0.0:1782241491.199994:0:20821:0:(genops.c:865:class_export_destroy()) destroying export ffff890e521b8800/MDS_uuid for MDS 00000020:01000000:0.0:1782241491.199999:0:20821:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1782241491.200208:0:20821:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1782241491.716951:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782241492.742841:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782241492.742852:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241492.742854:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782241492.742857:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782241492.742871:0:36:0:(import.c:65:import_set_state_nolock()) ffff890e4548d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782241492.742880:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 550 00000100:00080000:3.0:1782241492.742885:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782241492.742892:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff890e4548d800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241492.742928:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7d635500 x1868815140091136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241492.742976:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782241492.742980:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782241492.742981:0:36:0:(import.c:65:import_set_state_nolock()) ffff890e7d6de800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1782241492.743022:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140091136:0@lo:38:kworker.0 00000400:00000100:1.0:1782241492.743078:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140091136 offset 0 length 520: 4 00000100:00100000:2.0:1782241492.743261:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140091264:0@lo:400:kworker.0 00000100:00080000:3.0:1782241492.743301:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 550 00000100:00080000:3.0:1782241492.743304:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782241492.743309:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff890e7d6de800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241492.743324:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7d634000 x1868815140091392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241492.743378:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140091520:0@lo:400:kworker.0 00000100:00100000:1.0:1782241492.744224:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140091392:0@lo:38:kworker.0 00000400:00000100:2.0:1782241492.744280:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140091264 offset 0 length 224: 4 00000400:00000100:3.0:1782241492.748293:0:3639:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140091520 offset 0 length 224: 4 00000400:00000100:1.0:1782241492.751395:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140091392 offset 0 length 520: 4 00010000:00010000:3.0:1782241492.751828:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241493.765140:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782241494.791927:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241494.791939:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782241494.791942:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241494.791945:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782241494.792019:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241494.792023:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782241494.792113:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140091776:0@lo:400:kworker.0 00000400:00000100:1.0:1782241494.792652:0:3637:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140091776 offset 0 length 224: 4 00010000:00010000:1.0:1782241494.793376:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241494.793453:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241494.793575:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140091648:0@lo:400:kworker.0 00000400:00000100:3.0:1782241494.793610:0:3639:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140091648 offset 0 length 224: 4 00000020:01000004:0.0:1782241494.801640:0:21022:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1782241494.821645:0:21022:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1782241494.821704:0:21022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241494.821720:0:21022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241494.821727:0:21022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241494.821748:0:21022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241494.821804:0:21022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782241494.821811:0:21022:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1782241494.821848:0:21022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782241494.821861:0:21022:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7d635500 x1868815140091136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782241507 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241494.821875:0:21022:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782241494.821881:0:21022:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782241494.821887:0:21022:0:(import.c:65:import_set_state_nolock()) ffff890e4548d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1782241494.821893:0:21022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782241494.821896:0:21022:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7d635500 x1868815140091136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782241507 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241494.821904:0:21022:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782241494.821907:0:21022:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1782241494.822262:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140091136:0@lo:38:kworker.0 00010000:00010000:3.0:1782241494.822420:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241494.822427:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241494.822436:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860e00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241494.822440:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241494.822449:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241494.822457:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241494.822463:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782241494.822465:0:17036:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1782241494.822467:0:17036:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1782241494.822481:0:17036:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890d48881000 00010000:00010000:3.0:1782241494.822485:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241494.822491:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241494.822510:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241494.822512:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241494.822513:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782241494.823557:0:21022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1782241494.823569:0:21022:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7d636a00 x1868815140091264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241508 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241494.823595:0:21022:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d4803ad80 x1868815140091648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241510 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241494.823612:0:21022:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782241494.823617:0:21022:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1782241494.823639:0:21022:0:(import.c:65:import_set_state_nolock()) ffff890d47b7c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1782241494.823808:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140091648:0@lo:400:kworker.0 00000100:00100000:1.0:1782241494.823891:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140091264:0@lo:400:kworker.0 00000100:00100000:1.0:1782241494.823927:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1868815140091904:0@lo:39:umount.0 00000400:00000100:1.0:1782241494.823973:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140091904 offset 0 length 224: 4 00000100:00080000:2.0:1782241495.813042:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241495.813052:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241495.813055:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241495.813058:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782241495.813181:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140092032:0@lo:400:kworker.0 00000400:00000100:1.0:1782241495.813237:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140092032 offset 0 length 224: 4 00010000:00010000:3.0:1782241495.813404:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241496.837022:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782241496.837167:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241496.837173:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782241496.837176:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241496.837179:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782241496.837287:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241496.837310:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140092160:0@lo:400:kworker.0 00000400:00000100:3.0:1782241496.837362:0:3640:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140092160 offset 0 length 224: 4 00000001:00100000:0.0:1782241496.841411:0:19368:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782241496.841424:0:19368:0:(genops.c:906:class_export_put()) final put ffff890e7c194000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782241496.841559:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7c194000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1782241496.841626:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7c193800 for lustre-OST0001 00000001:00100000:2.0:1782241496.842108:0:18550:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782241496.842113:0:18550:0:(genops.c:906:class_export_put()) final put ffff890e42fa7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782241496.845712:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e42fa7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1782241496.845846:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d47b79800 for lustre-OST0000 00010000:00010000:3.0:1782241497.860970:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241498.884984:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241499.909221:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241500.934673:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241500.996971:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241490/real 1782241490] req@ffff890e7f686d80 x1868815140090752/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782241500 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241500.997041:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e7f686d80 x1868815140090752/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782241500 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782241500.997067:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48881000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241500.997102:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1782241500.997107:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3636:1868815140090752:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1782241500.997250:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241500.997257:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1782241500.997260:0:36:0:(import.c:65:import_set_state_nolock()) ffff890d48881000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241500.997265:0:36:0:(import.c:512:import_select_connection()) MGC192.168.204.158@tcp: connect to NID 0@lo last attempt 554 00000100:00080000:2.0:1782241500.997273:0:36:0:(import.c:591:import_select_connection()) MGC192.168.204.158@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782241500.997282:0:36:0:(import.c:626:import_select_connection()) MGC192.168.204.158@tcp: import ffff890d48881000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241500.997325:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f685500 x1868815140092288/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241500.997367:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241500.997371:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782241500.997492:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241500.997520:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140092416:0@lo:400:kworker.0 00000400:00000100:0.0:1782241500.997594:0:3639:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140092416 offset 0 length 224: 4 00000100:00100000:1.0:1782241500.997812:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3636:1868815140092288:0@lo:250:kworker.0 00000400:00000100:1.0:1782241500.997840:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868815140092288 offset 0 length 520: 4 00010000:00010000:3.0:1782241501.957809:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241502.981009:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241504.005614:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241504.068912:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241494/real 1782241494] req@ffff890e778dd880 x1868815140091904/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782241504 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241504.068946:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e778dd880 x1868815140091904/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782241504 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782241504.068968:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d47b7c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1782241504.068985:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1868815140091904:0@lo:39:umount.0 00000100:00080000:0.0:1782241504.069115:0:21022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1782241504.069119:0:21022:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782241504.069125:0:21022:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782241504.070029:0:21022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241504.070044:0:21022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241504.070052:0:21022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241504.070059:0:21022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241504.070090:0:21022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241504.070098:0:21022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241504.070105:0:21022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241504.070111:0:21022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241504.070122:0:21022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241504.070151:0:21022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1782241504.070155:0:21022:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1782241504.070180:0:21022:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1782241504.070184:0:21022:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1782241504.070188:0:21022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241504.070193:0:21022:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782241504.070197:0:21022:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff890e43fecd40) has no exports 00000020:00080000:0.0:1782241504.070219:0:21022:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff890e43fecd40) has no exports 00000020:01000000:0.0:1782241504.071813:0:21022:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890e46746120 - data ffff890e78cfeaf8/ffff890e7c188c00 00000020:01000000:0.0:1782241504.071937:0:21022:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d48073480 - data ffff890e78ddf5e8/ffff890e78087c00 00010000:00010000:1.0:1782241504.072330:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241504.072340:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241504.072351:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241504.072356:0:18201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241504.072366:0:18201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241504.072391:0:18201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241504.072397:0:18201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241504.072400:0:18201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1782241504.072403:0:18201:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1782241504.072421:0:18201:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890d48881000 00010000:00010000:1.0:1782241504.072425:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241504.072432:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241504.072443:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241504.072446:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241504.072452:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebe00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241504.072454:0:18201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241504.072461:0:18201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241504.072466:0:18201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241504.072471:0:18201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1782241504.072473:0:18201:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1782241504.072480:0:18201:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1782241504.072485:0:18201:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890d48881000 00010000:00010000:1.0:1782241504.072488:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241504.072495:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241504.072510:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241504.072512:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241504.072514:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241504.072575:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1782241504.081605:0:21022:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1782241504.094026:0:21022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1aa42 00000020:00000080:1.0:1782241504.094049:0:21022:0:(genops.c:906:class_export_put()) final put ffff890d47b7b000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1782241504.094080:0:21022:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e8140e800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1782241504.094092:0:21022:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e8140e800 2 00000020:01000004:1.0:1782241504.094097:0:21022:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff890e8140e800 from lustre-OST0000 00000020:00000080:1.0:1782241504.094136:0:21022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241504.094149:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47b7b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1782241504.094152:0:21022:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1782241504.094159:0:21022:0:(genops.c:906:class_export_put()) final put ffff890d47b7a000/lustre-OST0000_UUID 00000020:00000080:1.0:1782241504.094166:0:21022:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47b7a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1782241504.094178:0:21022:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1782241504.094280:0:21022:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1782241504.094287:0:21022:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1782241504.094292:0:21022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241504.094299:0:21022:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782241504.094309:0:21022:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff890e48138000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782241504.094316:0:21022:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff890e43633380) has exports, disconnecting them 00000020:00080000:1.0:1782241504.094322:0:21022:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff890e48138000), last request at 1782241424 00000020:00000080:1.0:1782241504.094327:0:21022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1aa6c 00000020:00080000:1.0:1782241504.094339:0:21022:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e48138000): rc 0 00000020:00000080:1.0:1782241504.094345:0:21022:0:(genops.c:906:class_export_put()) final put ffff890e48138000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1782241504.094404:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e48138000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1782241504.098881:0:21022:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1782241504.098894:0:21022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241504.098900:0:21022:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782241504.098909:0:21022:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241504.099107:0:21022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241504.099120:0:21022:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1782241504.099128:0:21022:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1782241504.099134:0:21022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241504.099140:0:21022:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782241504.099149:0:21022:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff890d47b78000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782241504.099157:0:21022:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff890e503f0000) has exports, disconnecting them 00000020:00080000:3.0:1782241504.099161:0:21022:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff890d47b78000), last request at 1782241424 00000020:00000080:3.0:1782241504.099166:0:21022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1aa81 00000020:00080000:3.0:1782241504.099210:0:21022:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890d47b78000): rc 0 00000020:00000080:3.0:1782241504.099218:0:21022:0:(genops.c:906:class_export_put()) final put ffff890d47b78000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1782241504.099503:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e4548d800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1782241504.099514:0:36:0:(genops.c:906:class_export_put()) final put ffff890e4813c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1782241504.099518:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e4813c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1782241504.099526:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1782241504.099624:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47b78000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1782241504.103129:0:21022:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1782241504.103144:0:21022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782241504.103151:0:21022:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782241504.103160:0:21022:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241504.103396:0:21022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241504.103409:0:21022:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1782241504.103421:0:21022:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e8140e800 1 00000020:00000080:3.0:1782241504.103433:0:21022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1aa1f 00000020:00000080:3.0:1782241504.103448:0:21022:0:(genops.c:906:class_export_put()) final put ffff890e67fe6000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1782241504.103456:0:21022:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1782241504.103468:0:21022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241504.103473:0:21022:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782241504.103479:0:21022:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff890e43fe8000) has no exports 00000020:00000080:3.0:1782241504.109656:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d47b7c000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1782241504.109683:0:36:0:(genops.c:906:class_export_put()) final put ffff890e4813b000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1782241504.109689:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e4813b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1782241504.109712:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1782241504.109872:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e67fe6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1782241504.141170:0:21022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241504.141192:0:21022:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1782241504.141199:0:21022:0:(genops.c:906:class_export_put()) final put ffff890e8140c800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1782241504.141205:0:21022:0:(genops.c:865:class_export_destroy()) destroying export ffff890e8140c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1782241504.141229:0:21022:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1782241504.141419:0:21022:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff890e81409000 00000020:02000400:3.0:1782241504.141485:0:21022:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1782241505.029934:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241506.054260:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782241506.055130:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241506.055140:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241506.055143:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241506.055147:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782241506.055472:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140092544:0@lo:400:kworker.0 00000400:00000100:0.0:1782241506.055547:0:3637:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140092544 offset 0 length 224: 4 00010000:00010000:3.0:1782241507.088684:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241507.143207:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241492/real 1782241492] req@ffff890e7d634000 x1868815140091392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1782241507 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241507.143248:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e7d634000 x1868815140091392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1782241507 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782241507.143265:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d6de800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241507.143285:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782241507.143289:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140091392:0@lo:38:kworker.0 00000100:00080000:2.0:1782241507.143317:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241507.143322:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241507.143325:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241507.143328:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782241507.143331:0:468:0:(import.c:65:import_set_state_nolock()) ffff890e7d6de800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241507.143335:0:468:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 556 00000100:00080000:2.0:1782241507.143341:0:468:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782241507.143346:0:468:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff890e7d6de800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241507.143375:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f684e00 x1868815140092672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782241507.143446:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241507.143457:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140092800:0@lo:400:kworker.0 00000400:00000100:2.0:1782241507.143502:0:3637:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140092800 offset 0 length 224: 4 00000100:00100000:3.0:1782241507.144201:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140092672:0@lo:38:kworker.0 00000400:00000100:3.0:1782241507.144227:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140092672 offset 0 length 520: 4 00000020:01000004:3.0:1782241507.617948:0:21224:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1782241507.637462:0:21224:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1782241507.637545:0:21224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241507.637561:0:21224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241507.637568:0:21224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241507.637584:0:21224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241507.637609:0:21224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782241507.637614:0:21224:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1782241507.637649:0:21224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782241507.637661:0:21224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7f684e00 x1868815140092672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782241527 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241507.637678:0:21224:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782241507.637711:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d6de800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241507.637715:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1782241507.637719:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140092672:0@lo:38:kworker.0 00000100:00080000:0.0:1782241507.637745:0:21224:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782241507.637750:0:21224:0:(import.c:65:import_set_state_nolock()) ffff890e7d6de800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1782241507.637784:0:21224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782241507.637786:0:21224:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782241507.637788:0:21224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1782241507.638501:0:21224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1782241507.638509:0:21224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7d634700 x1868815140091520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241508 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241507.638530:0:21224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d4803a680 x1868815140091776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241510 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241507.638543:0:21224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7f685880 x1868815140092032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241511 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241507.638555:0:21224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d48038e00 x1868815140092160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241507.638586:0:21224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7f686a00 x1868815140092416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241516 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241507.638594:0:21224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7f687b80 x1868815140092544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241522 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241507.638602:0:21224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7f684000 x1868815140092800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241523 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241507.638620:0:21224:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782241507.638625:0:21224:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1782241507.638647:0:21224:0:(import.c:65:import_set_state_nolock()) ffff890e476e5000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1782241507.638678:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1868815140092928:0@lo:39:umount.0 00000400:00000100:0.0:1782241507.638731:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140092928 offset 0 length 224: 4 00010000:00010000:1.0:1782241507.638880:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241507.638889:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241507.638898:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0c00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241507.638902:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241507.638911:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241507.638919:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241507.638924:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241507.638927:0:17036:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1782241507.638930:0:17036:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1782241507.638943:0:17036:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890d48881000 00010000:00010000:1.0:1782241507.638948:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241507.638955:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241507.638967:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241507.638969:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241507.638970:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241507.638989:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140092032:0@lo:400:kworker.0 00000100:00100000:3.0:1782241507.639242:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140092160:0@lo:400:kworker.0 00000100:00100000:3.0:1782241507.641605:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140092416:0@lo:400:kworker.0 00000100:00100000:3.0:1782241507.641620:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140091520:0@lo:400:kworker.0 00000100:00100000:3.0:1782241507.641660:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140092800:0@lo:400:kworker.0 00000100:00100000:3.0:1782241507.641668:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140092544:0@lo:400:kworker.0 00000100:00100000:3.0:1782241507.641675:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140091776:0@lo:400:kworker.0 00010000:00010000:1.0:1782241508.100917:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241509.125473:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241510.148889:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241511.174029:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782241512.196927:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782241512.196936:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1782241512.197667:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241513.221170:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241514.244913:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241515.270473:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241515.848986:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241500/real 1782241500] req@ffff890e7f685500 x1868815140092288/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782241515 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241515.849018:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e7f685500 x1868815140092288/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782241515 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782241515.849038:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48881000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241515.849064:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1782241515.849068:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3636:1868815140092288:0@lo:250:kworker.0 00000100:00080000:3.0:1782241515.849215:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782241515.849220:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1782241515.849223:0:468:0:(import.c:65:import_set_state_nolock()) ffff890d48881000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782241515.849228:0:468:0:(import.c:512:import_select_connection()) MGC192.168.204.158@tcp: connect to NID 0@lo last attempt 564 00000100:00080000:3.0:1782241515.849249:0:468:0:(import.c:591:import_select_connection()) MGC192.168.204.158@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1782241515.849255:0:468:0:(import.c:626:import_select_connection()) MGC192.168.204.158@tcp: import ffff890d48881000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241515.849282:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7d634700 x1868815140093056/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241515.851070:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3636:1868815140093056:0@lo:250:kworker.0 00000400:00000100:0.0:1782241515.851127:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868815140093056 offset 0 length 520: 4 00010000:00010000:1.0:1782241516.292929:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241517.317859:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241517.895434:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241507/real 1782241507] req@ffff890e778ddf80 x1868815140092928/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782241517 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241517.895480:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e778ddf80 x1868815140092928/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782241517 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782241517.895508:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e476e5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782241517.895540:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1868815140092928:0@lo:39:umount.0 00000100:00080000:3.0:1782241517.896065:0:21224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782241517.896072:0:21224:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782241517.896078:0:21224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1782241517.901803:0:21224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241517.901831:0:21224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241517.901840:0:21224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241517.901849:0:21224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241517.901887:0:21224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241517.901897:0:21224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241517.901905:0:21224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241517.901912:0:21224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241517.901919:0:21224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241517.902105:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241517.902116:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241517.902126:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861c00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241517.902131:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241517.902141:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241517.902150:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241517.902156:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782241517.902159:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1782241517.902174:0:17035:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890d48881000 00010000:00010000:3.0:1782241517.902180:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241517.902187:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241517.902244:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241517.902246:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241517.902249:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241517.902559:0:21224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782241517.902567:0:21224:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1782241517.902573:0:21224:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1782241517.902621:0:21224:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1782241517.902627:0:21224:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1782241517.902634:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782241517.902643:0:21224:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782241517.902648:0:21224:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff890e43630000) has no exports 00000020:00080000:2.0:1782241517.902690:0:21224:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff890e43630000) has no exports 00000020:01000000:2.0:1782241517.908349:0:21224:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d48208c00 - data ffff890e78e921b0/ffff890e7c18b000 00000020:01000000:2.0:1782241517.908572:0:21224:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d48208000 - data ffff890e78d45438/ffff890e78320c00 00010000:00010000:1.0:1782241517.909741:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241517.909779:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241517.909795:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb000 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241517.909801:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241517.909815:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241517.909823:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241517.909830:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1782241517.909833:0:17036:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1782241517.909836:0:17036:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1782241517.909859:0:17036:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890d48881000 00010000:00010000:1.0:1782241517.909863:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241517.910064:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241517.910088:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241517.910110:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241517.910112:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1782241517.919643:0:21224:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1782241517.937315:0:21224:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1aadc 00000020:00000080:3.0:1782241517.937331:0:21224:0:(genops.c:906:class_export_put()) final put ffff890d47563800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1782241517.939117:0:21224:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e436de000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1782241517.939127:0:21224:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e436de000 2 00000020:01000004:3.0:1782241517.939132:0:21224:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff890e436de000 from lustre-OST0001 00000020:00000080:0.0:1782241517.939135:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47563800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1782241517.939184:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241517.939196:0:21224:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1782241517.939200:0:21224:0:(genops.c:906:class_export_put()) final put ffff890e48dcf800/lustre-OST0001_UUID 00000020:00000080:3.0:1782241517.939204:0:21224:0:(genops.c:865:class_export_destroy()) destroying export ffff890e48dcf800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1782241517.939214:0:21224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1782241517.939324:0:21224:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS 00010000:00010000:3.0:1782241517.939353:0:21224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1a8eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1a8f2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241517.939365:0:21224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1a8eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1a8f2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241517.939380:0:21224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1782241517.939382:0:21224:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1782241517.939385:0:21224:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1782241517.939400:0:21224:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890d48881000 00010000:00010000:3.0:1782241517.939404:0:21224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1a8eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1a8f2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241517.939420:0:21224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241517.939441:0:21224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241517.939447:0:21224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782241517.939449:0:21224:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1782241517.939451:0:21224:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1782241517.939461:0:21224:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890d48881000 00010000:00010000:3.0:1782241517.939464:0:21224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782241517.939483:0:21224:0:(import.c:65:import_set_state_nolock()) ffff890d48881000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1782241517.939487:0:21224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1782241517.939489:0:21224:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1782241517.939491:0:21224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1782241517.939496:0:21224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1782241517.939507:0:21224:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e7d634700 x1868815140093056/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782241535 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1782241517.939534:0:21224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1782241517.939537:0:21224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:0.0:1782241517.939685:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3636:1868815140093056:0@lo:250:kworker.0 10000000:01000000:3.0:1782241517.940926:0:21224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1782241517.940949:0:21224:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1a7c5 00000020:00000080:3.0:1782241517.940958:0:21224:0:(genops.c:906:class_export_put()) final put ffff890e521bf000/f5d8e322-cb86-4bf4-a411-4939f9bbdcbb 00000020:01000000:3.0:1782241517.940983:0:21224:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.158@tcp (flags='') 00000020:00000080:3.0:1782241517.940990:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241517.940996:0:21224:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.158@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782241517.941000:0:21224:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff890d4691cd40) has no exports 10000000:01000000:3.0:1782241517.941039:0:17044:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1782241517.941113:0:21224:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.158@tcp: client import never connected 00000100:00080000:3.0:1782241517.941117:0:21224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1782241517.941120:0:21224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1782241517.941135:0:21224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1782241517.941138:0:21224:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1782241517.941199:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241517.941204:0:21224:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.158@tcp (uuid f5d8e322-cb86-4bf4-a411-4939f9bbdcbb) 00000020:01000000:3.0:1782241517.941210:0:21224:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1782241517.941213:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241517.941216:0:21224:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782241517.941221:0:21224:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff890e43fd4000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782241517.941231:0:21224:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff890e503f4d40) has exports, disconnecting them 00000020:00080000:3.0:1782241517.941235:0:21224:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff890e43fd4000), last request at 1782241439 00000020:00000080:3.0:1782241517.941239:0:21224:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ab06 00000020:00080000:3.0:1782241517.941249:0:21224:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e43fd4000): rc 0 00000020:00000080:3.0:1782241517.941252:0:21224:0:(genops.c:906:class_export_put()) final put ffff890e43fd4000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1782241517.941584:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e521bf000/f5d8e322-cb86-4bf4-a411-4939f9bbdcbb for MGC192.168.204.158@tcp 00000020:00000080:1.0:1782241517.941597:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d48881000 for MGC192.168.204.158@tcp 00000020:00000080:1.0:1782241517.941606:0:468:0:(genops.c:906:class_export_put()) final put ffff890d48884000/f5d8e322-cb86-4bf4-a411-4939f9bbdcbb 00000020:00000080:1.0:1782241517.941608:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d48884000/f5d8e322-cb86-4bf4-a411-4939f9bbdcbb for MGC192.168.204.158@tcp 00000020:01000000:1.0:1782241517.941614:0:468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.158@tcp (f5d8e322-cb86-4bf4-a411-4939f9bbdcbb) 00000020:00000080:1.0:1782241517.941906:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43fd4000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1782241517.952838:0:21224:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1782241517.952847:0:21224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782241517.952852:0:21224:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1782241517.952860:0:21224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782241517.953050:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241517.953059:0:21224:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1782241517.953065:0:21224:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1782241517.953071:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241517.953075:0:21224:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782241517.953090:0:21224:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff890e53be9000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782241517.953097:0:21224:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff890e503f19c0) has exports, disconnecting them 00000020:00080000:1.0:1782241517.953101:0:21224:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff890e53be9000), last request at 1782241439 00000020:00000080:1.0:1782241517.953106:0:21224:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1ab1b 00000020:00080000:1.0:1782241517.953121:0:21224:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e53be9000): rc 0 00000020:00000080:1.0:1782241517.953127:0:21224:0:(genops.c:906:class_export_put()) final put ffff890e53be9000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1782241517.953494:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7d6de800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1782241517.953502:0:468:0:(genops.c:906:class_export_put()) final put ffff890e4548e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1782241517.953505:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e4548e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1782241517.953518:0:468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1782241517.955154:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e53be9000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1782241517.967836:0:21224:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1782241517.967847:0:21224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782241517.967852:0:21224:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782241517.967860:0:21224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241517.967895:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e476e5000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1782241517.973520:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1782241517.973690:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1782241517.975715:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1782241517.976107:0:17030:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff890d4790dc00:17030] 0 exiting: rc = 1 00000100:00100000:3.0:1782241517.979560:0:17031:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff890d4790d600:17031] 1 exiting: rc = 0 00000100:00100000:3.0:1782241517.979682:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241517.982191:0:17034:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff890e567a0a00:17034] 2 exiting: rc = 0 00000100:00100000:3.0:1782241517.982329:0:17032:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff890d4790c600:17032] 0 exiting: rc = 1 00000100:00100000:3.0:1782241518.018896:0:17033:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff890d4790d400:17033] 1 exiting: rc = 0 00000100:00100000:3.0:1782241518.019076:0:20076:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff890d45b85c00:20076] 3 exiting: rc = 0 00000100:00100000:3.0:1782241518.019155:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019164:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019172:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019179:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019185:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019191:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019200:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019206:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019212:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019219:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019225:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019231:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019237:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019243:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019250:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019257:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019263:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019269:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019274:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019280:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019286:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019291:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019297:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019303:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019309:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019316:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019321:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019327:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019333:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019339:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019347:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019353:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019359:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019365:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019390:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019395:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019401:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019407:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019413:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019422:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019433:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019444:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019450:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019457:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019463:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019469:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019475:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019481:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019487:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019492:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019497:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019503:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019508:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019513:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019519:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019524:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019529:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019533:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019538:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019542:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019548:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019554:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019559:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241518.019565:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1782241518.020389:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241518.020402:0:21224:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1782241518.020409:0:21224:0:(genops.c:906:class_export_put()) final put ffff890e43fd1800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1782241518.020415:0:21224:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43fd1800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1782241518.020422:0:21224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1782241518.020491:0:21224:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e436de000 1 00000020:00000080:3.0:1782241518.020499:0:21224:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1aac0 00000020:00000080:3.0:1782241518.020507:0:21224:0:(genops.c:906:class_export_put()) final put ffff890e4813e800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1782241518.020520:0:21224:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1782241518.020532:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e4813e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1782241518.020545:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241518.020551:0:21224:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782241518.020556:0:21224:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff890e43634d40) has no exports 00000020:00000080:2.0:1782241518.077515:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241518.077529:0:21224:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1782241518.077534:0:21224:0:(genops.c:906:class_export_put()) final put ffff890e436dd800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1782241518.077539:0:21224:0:(genops.c:865:class_export_destroy()) destroying export ffff890e436dd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1782241518.077549:0:21224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1782241518.077934:0:21224:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff890e436db000 00000020:01000000:2.0:1782241518.077963:0:21224:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1782241518.077968:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782241518.077972:0:21224:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782241518.077975:0:21224:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff890d46918000) has no exports 00000020:00000080:2.0:1782241518.078002:0:21224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241518.078007:0:21224:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1782241518.078011:0:21224:0:(genops.c:906:class_export_put()) final put ffff890e67fe7000/OSS_uuid 00000020:00000080:2.0:1782241518.078013:0:21224:0:(genops.c:865:class_export_destroy()) destroying export ffff890e67fe7000/OSS_uuid for OSS 00000020:01000000:2.0:1782241518.078017:0:21224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1782241518.078160:0:18555:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff890e7c6cbe00:18555] 1 exiting: rc = 0 00000100:00100000:2.0:1782241518.078294:0:18554:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff890e7812cc00:18554] 0 exiting: rc = 1 00000100:00100000:2.0:1782241518.078365:0:19502:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff890d4670ce00:19502] 4 exiting: rc = 0 00000100:00080000:0.0:1782241518.078380:0:17043:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1782241518.078476:0:19173:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff890d410bc800:19173] 3 exiting: rc = 0 00000100:00100000:0.0:1782241518.078505:0:18556:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff890e42b94e00:18556] 2 exiting: rc = 0 00000100:00100000:0.0:1782241518.078629:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078639:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078644:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078649:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078654:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078659:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078664:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078669:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078673:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078678:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078683:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078689:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078694:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078699:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078705:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078710:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078715:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078720:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078736:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078745:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078750:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078772:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078780:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078787:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078794:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078803:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078809:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078814:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078819:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078832:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078837:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078842:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078847:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078851:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078856:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078861:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078867:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078871:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078876:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078881:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078886:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078891:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078896:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078901:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078906:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078911:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078916:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078927:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078933:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078938:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078943:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078949:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078954:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078959:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078963:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078969:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078973:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078978:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078982:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078987:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078991:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.078996:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.079000:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.079004:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.079895:0:18558:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff890d46b1cc00:18558] 1 exiting: rc = 0 00000100:00100000:2.0:1782241518.079993:0:18557:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff890e42b95800:18557] 0 exiting: rc = 1 00000100:00100000:0.0:1782241518.080083:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080089:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080094:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080099:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080103:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080108:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080114:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080118:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080123:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080127:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080132:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080136:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080141:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080145:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080149:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080155:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080159:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080164:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080168:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080173:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080178:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080183:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080187:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080192:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080197:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080201:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080205:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080209:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080214:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080218:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080223:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080227:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080231:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080235:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080249:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080253:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080259:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080264:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080269:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080274:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080279:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080283:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080288:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080293:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080298:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080303:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080308:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080313:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080317:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080321:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080326:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080330:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080334:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080338:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080342:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080348:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080352:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080357:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080361:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080365:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080382:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080387:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080392:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.080397:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.081330:0:18559:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff890e43fe3800:18559] 0 exiting: rc = 1 00000100:00100000:2.0:1782241518.081520:0:18561:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff890e43fe3200:18561] 2 exiting: rc = 0 00000100:00100000:1.0:1782241518.082700:0:18560:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff890e43fe2000:18560] 1 exiting: rc = 0 00000100:00100000:2.0:1782241518.082919:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.082927:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.082933:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.082939:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.082957:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.082964:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.082970:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.082976:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.082982:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.082987:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.082993:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.082998:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083004:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083010:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083016:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083022:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083027:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083033:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083039:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083045:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083052:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083057:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083064:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083069:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083075:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083080:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083086:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083107:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083128:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083139:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083148:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083154:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083159:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083165:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083171:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083176:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083182:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083188:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083194:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083199:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083205:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083211:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083217:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083222:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083228:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083234:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083239:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083245:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083251:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083256:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083261:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083266:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083283:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083288:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083294:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083300:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083306:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083311:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083317:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083323:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083336:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083343:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083360:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241518.083390:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.088575:0:18562:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff890e77fb4400:18562] 0 exiting: rc = 1 00000100:00100000:3.0:1782241518.089034:0:18563:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff890e781dc800:18563] 1 exiting: rc = 0 00000100:00100000:0.0:1782241518.090238:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090248:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090253:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090259:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090276:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090282:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090287:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090293:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090298:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090303:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090309:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090314:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090318:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090324:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090329:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090333:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090339:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090345:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090350:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090355:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090359:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090364:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090384:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090390:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090395:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090400:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090405:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090411:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090415:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090421:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090425:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090431:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090436:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090441:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090447:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090452:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090457:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090463:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090468:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090481:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090486:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090491:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090496:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090501:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090506:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090511:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090516:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090521:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090529:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090534:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090540:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090544:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090548:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090554:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090565:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090572:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090577:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090582:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090588:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090594:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090600:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090605:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090610:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241518.090616:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.091342:0:18565:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff890e78168800:18565] 1 exiting: rc = 0 00000100:00100000:3.0:1782241518.091475:0:18564:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff890e78080e00:18564] 0 exiting: rc = 1 00000100:00100000:1.0:1782241518.093057:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093069:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093098:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093104:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093110:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093115:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093121:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093126:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093132:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093138:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093148:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093155:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093175:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093185:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093192:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093202:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093212:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093219:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093225:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093233:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093238:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093244:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093250:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093254:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093269:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093274:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093280:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093287:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093297:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093306:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093314:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093319:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093327:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093332:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093338:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093343:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093380:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093391:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093396:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093401:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093407:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093412:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093417:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093422:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093427:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093432:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093438:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093443:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093459:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093465:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093470:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093476:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093481:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093487:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093492:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093497:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093502:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093508:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093513:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093519:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093535:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093542:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093547:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241518.093553:0:21224:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1782241518.100517:0:21224:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1782241541.725458:0:21990:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1782241557.027287:0:22591:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782241557.027293:0:22591:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1782241557.027295:0:22591:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1782241557.027418:0:22591:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff890d46713800 00000020:01000004:3.0:1782241557.027438:0:22591:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1782241557.027448:0:22591:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1782241557.027463:0:22591:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff890e77d98000) 00000020:00000080:3.0:1782241557.027477:0:22591:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1782241557.138004:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1782241557.139387:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1782241557.148829:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1782241557.149707:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1782241557.150997:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1782241557.151723:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1782241557.152456:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1782241557.153141:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1782241557.153644:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1782241557.154407:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1782241557.157427:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1782241557.159343:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1782241557.160151:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1782241557.160649:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1782241557.161150:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1782241557.161371:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1782241557.162368:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1782241557.164395:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1782241557.165352:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1782241557.172182:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1782241557.173695:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1782241557.174405:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1782241557.175701:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1782241557.176642:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1782241557.177689:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1782241557.178636:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1782241557.179634:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1782241557.181090:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1782241557.182586:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1782241557.189135:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1782241557.190172:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1782241557.190648:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1782241557.191173:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1782241557.191468:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1782241557.197260:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1782241557.199968:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1782241557.207133:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1782241557.208343:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1782241557.210124:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1782241557.210669:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1782241557.211041:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1782241557.211299:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1782241557.211686:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1782241557.215807:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1782241557.217712:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1782241557.218423:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1782241557.218666:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1782241557.222067:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1782241557.223468:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1782241557.223729:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1782241557.226383:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1782241557.226876:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1782241557.228260:0:22591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1782241557.230013:0:22591:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782241557.230333:0:22591:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782241557.230345:0:22591:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782241557.230362:0:22591:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1b0cb 00000020:01000004:2.0:1782241557.230373:0:22591:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1782241557.230380:0:22591:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782241557.230387:0:22591:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890d46713800 from MGS 00000020:01000004:2.0:1782241557.230392:0:22591:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782241557.230407:0:22591:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff890e43634d40) 00000020:00000080:2.0:1782241557.230421:0:22591:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782241557.230514:0:22591:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890d46713800 from MGS, refs=2 00080000:01000000:2.0:1782241557.230520:0:22591:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782241557.230525:0:22591:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1b0d9 00000100:00100000:2.0:1782241557.230647:0:22591:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782241557.230839:0:22591:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782241557.230847:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1782241557.232414:0:22591:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1782241557.232425:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1782241557.234176:0:22591:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782241557.234677:0:22591:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1782241557.234686:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1782241557.237371:0:22591:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1782241557.237386:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1782241557.241959:0:22591:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1782241557.241981:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1782241557.243572:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241557.243580:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241557.243582:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241557.244562:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241557.244568:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241557.244571:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241557.245623:0:22591:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1782241557.249364:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1782241557.263026:0:22591:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1782241557.264209:0:22603:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1782241557.264266:0:22591:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1782241557.264415:0:22591:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782241557.267657:0:22591:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1782241557.268203:0:22591:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782241557.268447:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1782241557.268453:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782241557.269961:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782241557.269977:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1782241557.272961:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1782241557.272978:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1782241557.274264:0:22591:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1782241557.274286:0:22591:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.158@tcp' 00000020:01000004:3.0:1782241557.274288:0:22591:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:2.0:1782241557.274491:0:22607:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1782241557.275180:0:22591:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.158@tcp (typ=mgc) 00000020:00000080:3.0:1782241557.275195:0:22591:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.158@tcp (ffff890e77d999c0) 00000020:00000080:3.0:1782241557.275215:0:22591:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1782241557.275424:0:22591:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d46710000@MGC192.168.204.158@tcp: add connection 192.168.204.158@tcp at head 00010000:00010000:3.0:1782241557.275655:0:22591:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.158@tcp-0 is initialized 00000040:01000000:3.0:1782241557.275661:0:22591:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 1 is initialized 10000000:01000000:2.0:1782241557.280991:0:22609:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1782241557.281088:0:22591:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.158@tcp (uuid 23eacdb9-0e56-4c3a-b421-5efac43515c0) 00000020:00000080:3.0:1782241557.281113:0:22591:0:(genops.c:1406:class_connect()) connect: client 23eacdb9-0e56-4c3a-b421-5efac43515c0, cookie 0xc9959f2fb1e1b0e7 00000100:00080000:3.0:1782241557.281127:0:22591:0:(import.c:512:import_select_connection()) MGC192.168.204.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782241557.281134:0:22591:0:(import.c:626:import_select_connection()) MGC192.168.204.158@tcp: import ffff890d46710000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241557.281168:0:22591:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7d634000 x1868815140093184/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241557.281191:0:22591:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 23eacdb9-0e56-4c3a-b421-5efac43515c0->MGS 00000020:01000004:3.0:1782241557.281219:0:22591:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1782241557.281224:0:22591:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1782241557.281443:0:22591:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff890e77d9b380) 00000020:00000080:3.0:1782241557.281457:0:22591:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1782241557.296943:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:23eacdb9-0e56-4c3a-b421-5efac43515c0:3636:1868815140093184:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1782241557.297051:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.297168:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140093184 00000100:00100000:1.0:1782241557.297179:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140093184 00000100:00100000:1.0:1782241557.297221:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241557.297229:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6d39e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1868815140093184:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1782241557.297265:0:22604:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 23eacdb9-0e56-4c3a-b421-5efac43515c0@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:1.0:1782241557.297304:0:22604:0:(genops.c:1406:class_connect()) connect: client 23eacdb9-0e56-4c3a-b421-5efac43515c0, cookie 0xc9959f2fb1e1b0f5 00000100:00080000:2.0:1782241557.301176:0:22604:0:(import.c:65:import_set_state_nolock()) ffff890d47b7e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241557.301288:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6d39e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+5:3636:x1868815140093184:12345-0@lo:250:mount.lustre.0 Request processed in 4056us (4236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241557.301318:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241557.301369:0:3636:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1782241557.301398:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.158@tcp: connect to target with instance 0 00000100:00080000:1.0:1782241557.301410:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1782241557.301417:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1782241557.301439:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d46710000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1782241557.301443:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1782241557.301464:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1782241557.301474:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:23eacdb9-0e56-4c3a-b421-5efac43515c0:3636:1868815140093184:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1782241557.311641:0:22591:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782241557.311954:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1782241557.311961:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1782241557.313949:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1782241557.313968:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1782241557.324670:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1782241557.324686:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1782241557.330780:0:22591:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782241557.331117:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1782241557.331131:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1782241557.334643:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1782241557.334656:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1782241557.382077:0:22591:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782241557.382251:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1782241557.382258:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1782241557.386142:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1782241557.386161:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782241557.389215:0:22591:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782241557.389405:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782241557.389412:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1782241557.390455:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782241557.390463:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1782241557.391056:0:22591:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782241557.391188:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782241557.391193:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1782241557.393140:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782241557.393152:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1782241557.393893:0:22591:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782241557.394048:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782241557.394053:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1782241557.395639:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782241557.395649:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1782241557.412115:0:22591:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782241557.412389:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782241557.412397:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1782241557.414420:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1782241557.414434:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1782241557.417539:0:22591:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782241557.417554:0:22591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1782241557.419032:0:22591:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1782241557.419063:0:22591:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1782241557.419069:0:22591:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1782241557.419176:0:22591:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782241557.419209:0:22591:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.158@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1782241557.419214:0:22591:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782241557.419215:0:22591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782241557.419217:0:22591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241557.419218:0:22591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241557.419219:0:22591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241557.419220:0:22591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241557.419221:0:22591:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241557.419223:0:22591:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782241557.419224:0:22591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241557.419226:0:22591:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782241557.419228:0:22591:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1782241557.419230:0:22591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782241557.419231:0:22591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782241557.419236:0:22591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241557.419237:0:22591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241557.419238:0:22591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241557.419239:0:22591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241557.419240:0:22591:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241557.419241:0:22591:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782241557.419242:0:22591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241557.419242:0:22591:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782241557.419278:0:22591:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782241557.419372:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093312:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782241557.419440:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241557.419539:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46806600 going to sleep for 11 seconds 00000100:00100000:2.0:1782241557.419704:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140093312 00000100:00100000:2.0:1782241557.419712:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140093312 00000100:00100000:2.0:1782241557.419910:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241557.419921:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+5:22591:x1868815140093312:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782241557.420044:0:22606:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782241557.420047:0:22606:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1782241557.420050:0:22606:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1782241557.420520:0:22627:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1782241557.421708:0:22606:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1782241557.431409:0:22628:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1782241557.431425:0:22628:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1782241557.431429:0:22628:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1782241557.431432:0:22628:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1782241557.433574:0:22628:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1782241557.434693:0:22606:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782241557.434710:0:22606:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782241557.441815:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+5:22591:x1868815140093312:12345-0@lo:253:mount.lustre.0 Request processed in 21887us (22366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241557.441831:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782241557.442059:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093312:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782241557.442075:0:22591:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782241557.442078:0:22591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782241557.442080:0:22591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782241557.442081:0:22591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241557.442082:0:22591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241557.442083:0:22591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241557.442084:0:22591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241557.442086:0:22591:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241557.442087:0:22591:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782241557.442089:0:22591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241557.442090:0:22591:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782241557.442115:0:22591:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890d46713800 from lustre-MDT0000 10000000:01000000:3.0:1782241557.442162:0:22591:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782241557.442165:0:22591:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782241557.442169:0:22591:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff890e77d999c0 10000000:01000000:3.0:1782241557.442173:0:22591:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782241557.442179:0:22591:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff890e77d999c0 from 1 10000000:01000000:3.0:1782241557.442182:0:22591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782241557.442221:0:22591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241557.442245:0:22591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241557.442255:0:22591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241557.442276:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782241557.443487:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241557.443541:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46806c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241557.445975:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140093440 00000100:00100000:2.0:1782241557.445991:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140093440 00000100:00100000:2.0:1782241557.446061:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241557.446071:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+5:22591:x1868815140093440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241557.446089:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241557.446115:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e43fac600/0xc9959f2fb1e1b103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b0fc expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241557.446162:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43fac600/0xc9959f2fb1e1b103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b0fc expref: 6 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241557.446173:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e43fac600/0xc9959f2fb1e1b103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b0fc expref: 6 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241557.446182:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac600, rc 0) 00000100:00100000:2.0:1782241557.447226:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+6:22591:x1868815140093440:12345-0@lo:101:mount.lustre.0 Request processed in 1152us (3738us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241557.447236:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241557.447315:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241557.447335:0:22591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.447346:0:22591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241557.447437:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241557.447477:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.447559:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241557.447644:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140093568 00000100:00100000:2.0:1782241557.447650:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140093568 00000100:00100000:2.0:1782241557.447717:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241557.447725:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+6:22591:x1868815140093568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241557.447820:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+6:22591:x1868815140093568:12345-0@lo:501:mount.lustre.0 Request processed in 96us (342us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782241557.447827:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241557.447875:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093568:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782241557.447905:0:22591:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782241557.447964:0:22591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.447973:0:22591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241557.447982:0:22591:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890d46713800 10000000:01000000:1.0:1782241557.447987:0:22591:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782241557.447990:0:22591:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff890d46713800 10000000:01000000:1.0:1782241557.448000:0:22591:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782241557.448003:0:22591:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff890d46713800 from 1 10000000:01000000:1.0:1782241557.448005:0:22591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782241557.448023:0:22591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c310a00/0xc9959f2fb1e1b10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.448028:0:22591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e7c310a00/0xc9959f2fb1e1b10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.448034:0:22591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e7c310a00/0xc9959f2fb1e1b10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241557.448042:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782241557.448060:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.448079:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241557.448096:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140093696 00000100:00100000:3.0:1782241557.448100:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140093696 00000100:00100000:3.0:1782241557.448159:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782241557.448221:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+6:22591:x1868815140093696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241557.448231:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241557.448243:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164d400/0xc9959f2fb1e1b111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b10a expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241557.448262:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164d400/0xc9959f2fb1e1b111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b10a expref: 7 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241557.448270:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164d400/0xc9959f2fb1e1b111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b10a expref: 7 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241557.448278:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d400, rc 0) 00000100:00100000:3.0:1782241557.448341:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+7:22591:x1868815140093696:12345-0@lo:101:mount.lustre.0 Request processed in 123us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241557.448345:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241557.448388:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241557.448396:0:22591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e7c310a00/0xc9959f2fb1e1b10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b111 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.448401:0:22591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e7c310a00/0xc9959f2fb1e1b10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b111 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241557.448408:0:22591:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782241557.448418:0:22591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c310a00/0xc9959f2fb1e1b10a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b111 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.448422:0:22591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e7c310a00/0xc9959f2fb1e1b10a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b111 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241557.448426:0:22591:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782241557.448432:0:22591:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782241557.448435:0:22591:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff890d46713800 10000000:01000000:1.0:1782241557.448436:0:22591:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782241557.448438:0:22591:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1782241557.448439:0:22591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782241557.448450:0:22591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c310c00/0xc9959f2fb1e1b118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.448454:0:22591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e7c310c00/0xc9959f2fb1e1b118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.448458:0:22591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e7c310c00/0xc9959f2fb1e1b118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241557.448465:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782241557.448482:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.448495:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241557.448559:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140093824 00000100:00100000:2.0:1782241557.448563:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140093824 00000100:00100000:2.0:1782241557.448610:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241557.448617:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+7:22591:x1868815140093824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241557.448624:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241557.448632:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e43fac000/0xc9959f2fb1e1b11f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b118 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241557.448644:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43fac000/0xc9959f2fb1e1b11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b118 expref: 8 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241557.448663:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e43fac000/0xc9959f2fb1e1b11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b118 expref: 8 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241557.448669:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac000, rc 0) 00000100:00100000:2.0:1782241557.448705:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+8:22591:x1868815140093824:12345-0@lo:101:mount.lustre.0 Request processed in 89us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241557.448711:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241557.448730:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241557.448740:0:22591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e7c310c00/0xc9959f2fb1e1b118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b11f expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.448747:0:22591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e7c310c00/0xc9959f2fb1e1b118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b11f expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241557.448932:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241557.448957:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.448983:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241557.449030:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140093952 00000100:00100000:3.0:1782241557.449033:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140093952 00000100:00100000:3.0:1782241557.449054:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782241557.449060:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+8:22591:x1868815140093952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241557.449240:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+9:22591:x1868815140093952:12345-0@lo:501:mount.lustre.0 Request processed in 178us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241557.449247:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241557.449284:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140093952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241557.449325:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140094080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241557.449363:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.449382:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241557.449431:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140094080 00000100:00100000:2.0:1782241557.449435:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140094080 00000100:00100000:3.0:1782241557.449615:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782241557.449623:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+9:22591:x1868815140094080:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241557.456177:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+9:22591:x1868815140094080:12345-0@lo:503:mount.lustre.0 Request processed in 6540us (6798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241557.456193:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241557.456400:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140094080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241557.457055:0:22629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22629:1868815140094208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241557.457179:0:22629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241557.457219:0:22629:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982600 going to sleep for 11 seconds 00000100:00100000:1.0:1782241557.457278:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140094208 00000100:00100000:1.0:1782241557.457284:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140094208 00000100:00100000:1.0:1782241557.457388:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782241557.457398:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+9:22629:x1868815140094208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241557.458538:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+9:22629:x1868815140094208:12345-0@lo:502:llog_process_th.0 Request processed in 1136us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241557.458550:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782241557.459539:0:22629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22629:1868815140094208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782241557.459583:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241557.459605:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241557.459608:0:22629:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782241557.459614:0:22629:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1782241557.459617:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782241557.459636:0:22629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff890e77d9cd40) 00000020:00000080:3.0:1782241557.459719:0:22629:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1782241557.459726:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1782241557.461058:0:22629:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1782241557.461071:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1b12d 00000020:00000080:3.0:1782241557.461363:0:22629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782241557.461372:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241557.461384:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241557.461386:0:22629:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782241557.461390:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241557.461396:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241557.461397:0:22629:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1782241557.461402:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782241557.461413:0:22629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff890e81fc99c0) 00000020:00000080:3.0:1782241557.461425:0:22629:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1782241557.461429:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1782241557.461431:0:22629:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1782241557.461434:0:22629:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1782241557.461440:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782241557.461497:0:22629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890d46713800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1782241557.461511:0:22629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff890e81fcb380) 00000020:00000080:3.0:1782241557.461519:0:22629:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1782241557.461608:0:22629:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1782241557.461615:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1b142 00000020:00000080:0.0:1782241557.462236:0:22629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1782241557.462244:0:22629:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1782241557.462250:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc9959f2fb1e1b149 00080000:01000000:0.0:1782241557.462257:0:22629:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782241557.462263:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1b150 00010000:00010000:2.0:1782241557.538975:0:22629:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1782241557.540155:0:22629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:2.0:1782241557.544792:0:22629:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782241557.545797:0:22629:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff890e81fc8000) 00000020:00000080:3.0:1782241557.545817:0:22629:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782241557.545886:0:22629:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782241557.545893:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1b15e 00000020:00000080:3.0:1782241557.546402:0:22629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1782241557.550746:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc9959f2fb1e1b165 00000020:00000080:1.0:1782241557.551431:0:22629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782241557.551444:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241557.551451:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241557.551454:0:22629:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782241557.551457:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782241557.551461:0:22629:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1782241557.551463:0:22629:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782241557.551464:0:22629:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782241557.551466:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782241557.551469:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241557.551471:0:22629:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782241557.551474:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241557.551480:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241557.551481:0:22629:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782241557.551486:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782241557.551525:0:22629:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1782241557.551544:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241557.551554:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241557.551556:0:22629:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1782241557.551561:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241557.551565:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241557.551566:0:22629:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1782241557.551570:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782241557.551577:0:22629:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:00000080:1.0:1782241557.551660:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241557.551676:0:22629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff890e503f3380) 00000020:00000080:1.0:1782241557.551692:0:22629:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1782241557.551699:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782241557.552322:0:22629:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1782241557.552328:0:22629:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782241557.552337:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1b173 00010000:00080000:1.0:1782241557.552372:0:22629:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e7c699800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241557.555618:0:22629:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1782241557.557529:0:22629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782241557.557551:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1782241557.557610:0:22629:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1782241557.557634:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1b17a 00000100:00080000:3.0:1782241557.557645:0:22629:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782241557.557652:0:22629:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff890e7c699800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241557.557692:0:22629:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7d636300 x1868815140094336/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241557.557722:0:22629:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1782241557.557905:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140094336:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782241557.557985:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241557.558138:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140094336 00000100:00100000:3.0:1782241557.558153:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140094336 00000100:00100000:3.0:1782241557.558190:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782241557.558197:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140094336:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1782241557.558214:0:22616:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:2.0:1782241557.559330:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241557.559337:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241557.559339:0:22629:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1782241557.559343:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782241557.559346:0:22629:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1782241557.559348:0:22629:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782241557.559349:0:22629:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782241557.559351:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782241557.559354:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241557.559355:0:22629:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782241557.559358:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782241557.559363:0:22629:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1782241557.559367:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241557.559369:0:22629:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1782241557.559372:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782241557.559377:0:22629:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:2.0:1782241557.559401:0:22629:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782241557.559404:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782241557.559427:0:22629:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff890e43633380) 00000020:00000080:2.0:1782241557.559444:0:22629:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1782241557.559450:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782241557.559538:0:22629:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1782241557.559544:0:22629:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1782241557.559551:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1b188 00010000:00080000:2.0:1782241557.559582:0:22629:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d47b7a800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:2.0:1782241557.559876:0:22629:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1782241557.561444:0:22629:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782241557.563123:0:22629:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782241557.567471:0:22629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241557.568819:0:22629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1782241557.578083:0:22629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1782241557.578782:0:22635:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1782241557.578789:0:22635:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1782241557.579913:0:22629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782241557.579931:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782241557.579987:0:22629:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782241557.580016:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1b18f 00000100:00080000:2.0:1782241557.580032:0:22629:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782241557.580040:0:22629:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff890d47b7a800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241557.580090:0:22629:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f685f80 x1868815140094464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241557.580180:0:22629:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1782241557.580292:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241557.580297:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241557.580299:0:22629:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1782241557.580302:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782241557.580306:0:22629:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1782241557.580307:0:22629:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782241557.580309:0:22629:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782241557.580311:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782241557.580314:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241557.580326:0:22629:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782241557.580330:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782241557.580334:0:22629:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1782241557.580339:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241557.580340:0:22629:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1782241557.580344:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782241557.580349:0:22629:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:2.0:1782241557.580382:0:22629:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782241557.580385:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782241557.580410:0:22629:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff890e436319c0) 00000020:00000080:2.0:1782241557.580425:0:22629:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1782241557.580431:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782241557.580514:0:22629:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1782241557.580521:0:22629:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1782241557.580529:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1b19d 00010000:00080000:2.0:1782241557.580581:0:22629:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d48885000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:2.0:1782241557.580887:0:22629:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1782241557.580971:0:22629:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782241557.580989:0:22629:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1782241557.584002:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140094464:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1782241557.584076:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140094464 offset 0 length 520: 4 00000100:00100000:3.0:1782241557.597537:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140094336:12345-0@lo:38:llog_process_th.0 Request processed in 39324us (39537us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782241557.597557:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1782241557.597644:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7c699800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241557.597651:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782241557.597655:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140094336:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1782241557.598238:0:22629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241557.599332:0:22629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1782241557.603529:0:22629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1782241557.605223:0:22637:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1782241557.605232:0:22637:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1782241557.607109:0:22629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782241557.607129:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782241557.607191:0:22629:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782241557.607220:0:22629:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1b1a4 00000100:00080000:0.0:1782241557.607235:0:22629:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782241557.607243:0:22629:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff890d48885000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241557.607294:0:22629:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e778ddf80 x1868815140094592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241557.607395:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140094592:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782241557.607498:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140094592 offset 0 length 520: 4 00000100:00080000:0.0:1782241557.607636:0:22629:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1782241557.607724:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241557.607729:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241557.607731:0:22629:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1782241557.607735:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241557.607739:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241557.607741:0:22629:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782241557.607744:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782241557.607746:0:22629:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782241557.607748:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241557.607750:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241557.607802:0:22629:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782241557.607806:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241557.607810:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241557.607811:0:22629:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782241557.607815:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782241557.607862:0:22629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22629:1868815140094720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241557.607927:0:22629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241557.607970:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140094720 00000100:00100000:0.0:1782241557.607978:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140094720 00000100:00100000:0.0:1782241557.608022:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241557.608032:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+9:22629:x1868815140094720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241557.608175:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+9:22629:x1868815140094720:12345-0@lo:502:llog_process_th.0 Request processed in 144us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241557.608183:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241557.608236:0:22629:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241557.608261:0:22629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22629:1868815140094720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782241557.608293:0:22629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241557.608297:0:22629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241557.608298:0:22629:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782241557.608302:0:22629:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1782241557.610817:0:22591:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1782241557.610886:0:22591:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782241557.610916:0:22591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c310c00/0xc9959f2fb1e1b118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b11f expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.610933:0:22591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e7c310c00/0xc9959f2fb1e1b118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b11f expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241557.610942:0:22591:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d46713800 from 1 10000000:01000000:1.0:1782241557.610968:0:22591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782241557.611024:0:22591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.611033:0:22591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.611045:0:22591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241557.611078:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140094848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782241557.611173:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.611221:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a283c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241557.611409:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140094848 00000100:00100000:2.0:1782241557.611420:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140094848 00000100:00100000:2.0:1782241557.611493:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782241557.611505:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+9:22591:x1868815140094848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241557.611523:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241557.611541:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e1b1b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b1ab expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241557.611572:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e1b1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b1ab expref: 10 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241557.611604:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e1b1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b1ab expref: 10 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241557.611615:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43facc00, rc 0) 00000100:00100000:2.0:1782241557.611662:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+10:22591:x1868815140094848:12345-0@lo:101:mount.lustre.0 Request processed in 159us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241557.611670:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241557.611964:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140094848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241557.611982:0:22591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.611992:0:22591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241557.614031:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140094976:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1782241557.614134:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241557.614242:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241557.614645:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140094976 00000100:00100000:2.0:1782241557.614655:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140094976 00000100:00100000:2.0:1782241557.614802:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782241557.614815:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+10:22591:x1868815140094976:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1782241557.614963:0:22606:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1782241557.614974:0:22606:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1782241557.615086:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+10:22591:x1868815140094976:12345-0@lo:256:mount.lustre.0 Request processed in 273us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241557.615095:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782241557.615211:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140094976:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1782241557.615889:0:22591:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782241557.615912:0:22591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.615942:0:22591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241557.615953:0:22591:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d46713800 from 1 10000000:01000000:0.0:1782241557.615956:0:22591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782241557.615999:0:22591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.616008:0:22591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.616018:0:22591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241557.616040:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140095104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782241557.616090:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241557.620857:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241557.624746:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140095104 00000100:00100000:1.0:1782241557.629547:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140095104 00000100:00100000:1.0:1782241557.629651:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241557.629664:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+10:22591:x1868815140095104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241557.629686:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241557.629726:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b1c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b1b9 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.629798:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b1b9 expref: 11 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.629844:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b1b9 expref: 11 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.629855:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c310600, rc 0) 00000100:00100000:1.0:1782241557.629973:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:22591:x1868815140095104:12345-0@lo:101:mount.lustre.0 Request processed in 310us (13881us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241557.629981:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782241557.630537:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140095104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241557.630562:0:22591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.630573:0:22591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241557.630679:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140095232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241557.630722:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241557.630806:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241557.631647:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140095232 00000100:00100000:2.0:1782241557.631658:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140095232 00000100:00100000:2.0:1782241557.631720:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782241557.631731:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:22591:x1868815140095232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241557.632144:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:22591:x1868815140095232:12345-0@lo:501:mount.lustre.0 Request processed in 413us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241557.632153:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782241557.633068:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140095232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241557.633141:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140095360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241557.633603:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241557.636166:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241557.637512:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140095360 00000100:00100000:1.0:1782241557.637532:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140095360 00000100:00100000:1.0:1782241557.637634:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782241557.637647:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:22591:x1868815140095360:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241557.638414:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:22591:x1868815140095360:12345-0@lo:503:mount.lustre.0 Request processed in 760us (4813us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241557.638429:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782241557.638524:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140095360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241557.641263:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22639:1868815140095488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241557.641382:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.641584:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982600 going to sleep for 11 seconds 00000100:00100000:3.0:1782241557.641893:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140095488 00000100:00100000:3.0:1782241557.641904:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140095488 00000100:00100000:3.0:1782241557.641972:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782241557.641984:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:22639:x1868815140095488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241557.652381:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:22639:x1868815140095488:12345-0@lo:502:llog_process_th.0 Request processed in 10382us (10983us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241557.652433:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22639:1868815140095488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241557.652586:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000000:1.0:1782241557.652613:0:22639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241557.652627:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241557.652630:0:22639:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782241557.652639:0:22639:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890d46713800 00000020:00000080:1.0:1782241557.652643:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241557.652652:0:22639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241557.652656:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241557.652657:0:22639:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782241557.652660:0:22639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241557.652665:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241557.652677:0:22639:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782241557.652684:0:22639:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890d46713800 00000020:00000080:1.0:1782241557.652687:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241557.652910:0:22639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241557.652915:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241557.652916:0:22639:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782241557.652919:0:22639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241557.652921:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241557.652923:0:22639:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782241557.652926:0:22639:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890d46713800 00000020:00000080:1.0:1782241557.652928:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241557.654792:0:22639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241557.654989:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241557.654997:0:22639:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782241557.655010:0:22639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241557.655018:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241557.655020:0:22639:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1782241557.655029:0:22639:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890d46713800 00000020:00000080:2.0:1782241557.655034:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782241557.655174:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22639:1868815140095616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241557.655290:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241557.655362:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4542f840 going to sleep for 11 seconds 00000100:00100000:1.0:1782241557.655894:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140095616 00000100:00100000:1.0:1782241557.655905:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140095616 00000100:00100000:1.0:1782241557.655981:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782241557.655994:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:22639:x1868815140095616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241557.656182:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:22639:x1868815140095616:12345-0@lo:502:llog_process_th.0 Request processed in 188us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241557.656191:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241557.656463:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22639:1868815140095616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782241557.656690:0:22639:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241557.656699:0:22639:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241557.656702:0:22639:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1782241557.656707:0:22639:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1782241557.658798:0:22591:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1782241557.658869:0:22591:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782241557.658899:0:22591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.658914:0:22591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241557.658996:0:22591:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782241557.659001:0:22591:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890d46713800 10000000:01000000:1.0:1782241557.659005:0:22591:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890d46713800 10000000:01000000:1.0:1782241557.659012:0:22591:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782241557.659032:0:22591:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890d46713800 from 1 10000000:01000000:1.0:1782241557.659036:0:22591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782241557.659086:0:22591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c311400/0xc9959f2fb1e1b1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.659096:0:22591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e7c311400/0xc9959f2fb1e1b1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.659109:0:22591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e7c311400/0xc9959f2fb1e1b1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241557.659143:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140095744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782241557.659228:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.659296:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46806600 going to sleep for 11 seconds 00000100:00100000:3.0:1782241557.660014:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140095744 00000100:00100000:3.0:1782241557.660026:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140095744 00000100:00100000:3.0:1782241557.660097:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241557.660109:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:22591:x1868815140095744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241557.660130:0:22605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241557.660149:0:22605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1b1ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b1c7 expref: -99 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241557.660198:0:22605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1b1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b1c7 expref: 12 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241557.660210:0:22605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1b1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b1c7 expref: 12 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241557.660220:0:22605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d600, rc 0) 00000100:00100000:3.0:1782241557.660289:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22591:x1868815140095744:12345-0@lo:101:mount.lustre.0 Request processed in 181us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241557.660297:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241557.661749:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140095744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241557.661817:0:22591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e7c311400/0xc9959f2fb1e1b1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1ce expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241557.663801:0:22591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e7c311400/0xc9959f2fb1e1b1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b1ce expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241557.663970:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140095872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241557.664061:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241557.664108:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47934840 going to sleep for 11 seconds 00000100:00100000:1.0:1782241557.665226:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140095872 00000100:00100000:1.0:1782241557.665241:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140095872 00000100:00100000:1.0:1782241557.665320:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782241557.665333:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22591:x1868815140095872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241557.665562:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22591:x1868815140095872:12345-0@lo:501:mount.lustre.0 Request processed in 231us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241557.665570:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782241557.667281:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140095872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241557.667368:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140096000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241557.667574:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241557.667700:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47934840 going to sleep for 11 seconds 00000100:00100000:1.0:1782241557.670391:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140096000 00000100:00100000:1.0:1782241557.670420:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140096000 00000100:00100000:1.0:1782241557.670681:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782241557.670695:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22591:x1868815140096000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241557.674809:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22591:x1868815140096000:12345-0@lo:503:mount.lustre.0 Request processed in 4101us (7321us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241557.674830:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782241557.675024:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140096000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241557.675383:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22644:1868815140096128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241557.675474:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.678678:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e45e20780 going to sleep for 11 seconds 00000100:00100000:1.0:1782241557.680055:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140096128 00000100:00100000:1.0:1782241557.680072:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140096128 00000100:00100000:1.0:1782241557.680158:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782241557.680170:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22644:x1868815140096128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241557.680386:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22644:x1868815140096128:12345-0@lo:502:llog_process_th.0 Request processed in 217us (4911us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241557.680395:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782241557.680474:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22644:1868815140096128:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1782241557.680576:0:22644:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782241557.680605:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff890e503f19c0) 00000020:00000080:1.0:1782241557.680631:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1782241557.682229:0:22644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890d46713800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782241557.682241:0:22644:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890d46713800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782241557.682245:0:22644:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890d46713800 4 00010000:00080000:1.0:1782241557.682295:0:22644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d48030000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241557.689356:0:22644:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1782241557.689675:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782241557.689743:0:22644:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782241557.689920:0:22644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc9959f2fb1e1b1dc 00000100:00080000:1.0:1782241557.689937:0:22644:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241557.689946:0:22644:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff890d48030000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241557.690003:0:22644:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48038700 x1868815140096256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782241557.693227:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140096256:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782241557.693368:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782241557.694993:0:22644:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782241557.695223:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140096256 00000100:00100000:0.0:1782241557.695238:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140096256 00000100:00100000:0.0:1782241557.695282:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782241557.695291:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140096256:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782241557.695392:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140096256:12345-0@lo:38:llog_process_th.0 Request processed in 101us (2024us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782241557.695400:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241557.695622:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782241557.695636:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48030000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241557.695643:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782241557.695649:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140096256:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782241557.704009:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22644:1868815140096384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241557.704129:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.704188:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140096384 00000100:00100000:1.0:1782241557.704197:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140096384 00000100:00100000:1.0:1782241557.704253:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782241557.704266:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22644:x1868815140096384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241557.704427:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22644:x1868815140096384:12345-0@lo:502:llog_process_th.0 Request processed in 163us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241557.704437:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782241557.704502:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50217a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241557.704531:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22644:1868815140096384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241557.704585:0:22644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22644:1868815140096512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241557.704635:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.704666:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140096512 00000100:00100000:1.0:1782241557.704671:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140096512 00000100:00100000:1.0:1782241557.704709:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782241557.704718:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22644:x1868815140096512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241557.704835:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22644:x1868815140096512:12345-0@lo:502:llog_process_th.0 Request processed in 117us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241557.704842:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782241557.704890:0:22644:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50217a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241557.704909:0:22644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23eacdb9-0e56-4c3a-b421-5efac43515c0:22644:1868815140096512:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782241557.704936:0:22644:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1782241557.705034:0:22591:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1782241557.705074:0:22591:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782241557.705101:0:22591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c311400/0xc9959f2fb1e1b1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1ce expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.705114:0:22591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e7c311400/0xc9959f2fb1e1b1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1ce expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782241557.705181:0:22591:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782241557.705183:0:22591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782241557.705185:0:22591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241557.705187:0:22591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241557.705189:0:22591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241557.705191:0:22591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241557.705193:0:22591:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782241557.705196:0:22591:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782241557.705199:0:22591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241557.705201:0:22591:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782241557.705206:0:22591:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1782241557.705208:0:22591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782241557.705210:0:22591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782241557.705211:0:22591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241557.705213:0:22591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241557.705214:0:22591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241557.705216:0:22591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241557.705217:0:22591:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782241557.705218:0:22591:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782241557.705226:0:22591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241557.705227:0:22591:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782241557.705244:0:22591:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782241557.705259:0:22591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140096640:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782241557.705299:0:22591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.705316:0:22591:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50217a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241557.705337:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140096640 00000100:00100000:1.0:1782241557.705342:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140096640 00000100:00100000:1.0:1782241557.705373:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782241557.705380:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22591:x1868815140096640:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782241557.705404:0:22605:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782241557.705421:0:22605:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782241557.717981:0:22605:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782241557.718002:0:22605:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1782241557.718604:0:22627:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782241557.718612:0:22627:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782241557.718643:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.718668:0:22627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e1b1b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b1ab expref: 12 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.718680:0:22627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.718736:0:22627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e1b1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ab expref: 12 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.718775:0:22627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e1b1b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ab expref: 12 pid: 22604 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241557.718795:0:22627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140096768:0@lo:104: 00000100:00100000:2.0:1782241557.719162:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22591:x1868815140096640:12345-0@lo:253:mount.lustre.0 Request processed in 13778us (13857us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241557.719175:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782241557.719732:0:22591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:22591:1868815140096640:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782241557.719780:0:22591:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782241557.719784:0:22591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782241557.719785:0:22591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782241557.719787:0:22591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241557.719788:0:22591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241557.719789:0:22591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241557.719791:0:22591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241557.719792:0:22591:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241557.719793:0:22591:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782241557.719795:0:22591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241557.719796:0:22591:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782241557.719810:0:22591:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1782241557.719969:0:22627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241557.720034:0:22627:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50217840 going to sleep for 11 seconds 00000100:00100000:2.0:1782241557.720986:0:22595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140096768 00000100:00100000:2.0:1782241557.720998:0:22595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140096768 00000100:00100000:2.0:1782241557.721056:0:22595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241557.721067:0:22595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:22627:x1868815140096768:12345-0@lo:104: 00010000:00010000:2.0:1782241557.721092:0:22595:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241557.721179:0:22595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782241557.721187:0:22595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:22627:x1868815140096768:12345-0@lo:104: Request processed in 123us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241557.721205:0:22595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241557.721257:0:22627:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140096768:0@lo:104: 00010000:00010000:2.0:1782241557.721282:0:22627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.721629:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241557.721638:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.721648:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241557.721653:0:22601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.721663:0:22601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241557.721671:0:22601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241557.721678:0:22601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241557.721733:0:22601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.721741:0:22601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241557.721792:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.721800:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e7c311200/0xc9959f2fb1e1b1ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b1b2 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241557.721822:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241557.721824:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241557.721826:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241557.728092:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140096896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241557.728482:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241557.729500:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140096896 00000100:00100000:0.0:1782241557.729512:0:22597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140096896 00010000:00010000:0.0:1782241557.729547:0:22597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e1b1b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ab expref: 12 pid: 22604 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241557.729627:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782241557.729638:0:22597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:3639:x1868815140096896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241557.729664:0:22597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241557.729671:0:22597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e1b1b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ab expref: 12 pid: 22604 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.729686:0:22597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e1b1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ab expref: 12 pid: 22604 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.729718:0:22597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e1b1b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ab expref: 12 pid: 22604 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.729738:0:22597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.729748:0:22597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782241557.729797:0:22597:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011186535s 00010000:00010000:0.0:1782241557.729803:0:22597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.729811:0:22597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.729819:0:22597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.729825:0:22597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.729831:0:22597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311c00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241557.729836:0:22597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.729845:0:22597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.729863:0:22597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.729880:0:22597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241557.729946:0:22597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:3639:x1868815140096896:12345-0@lo:103:ldlm_bl.0 Request processed in 298us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241557.729955:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1782241557.729993:0:22627:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.730002:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241557.730010:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b1e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241557.730689:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140096896:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1782241557.753807:0:22591:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967531 00000020:00080000:2.0:1782241557.754162:0:22651:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967531 00000020:00080000:2.0:1782241557.754167:0:22651:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000040:01000000:3.0:1782241557.754218:0:22591:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1782241557.754545:0:22652:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1782241557.754640:0:22591:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1782241557.755040:0:22652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1782241557.755499:0:22591:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1782241557.755536:0:22591:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1782241557.756184:0:22653:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff890d48039880 x1868815140097024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241557.756215:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00000004:00000080:3.0:1782241557.756689:0:22591:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1782241557.756701:0:22591:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1782241557.756863:0:22591:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241557.758247:0:22652:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782241557.758337:0:22652:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1782241557.758722:0:22591:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782241557.759338:0:22591:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782241557.759384:0:22591:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1782241557.764016:0:22591:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1782241557.765161:0:22591:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1782241557.771340:0:22591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1782241557.776729:0:22591:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782241557.776884:0:22591:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa60ac1473988 00100000:10000000:3.0:1782241557.776893:0:22591:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782241557.778681:0:22591:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782241557.778701:0:22591:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782241557.778726:0:22591:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782241557.779269:0:22591:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1782241557.782062:0:22591:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241557.782374:0:22591:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782241558.277039:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782241558.470918:0:22609:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782241558.470928:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d46713800 from 11 10000000:01000000:2.0:1782241558.470934:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782241558.470985:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241558.470997:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241558.471009:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241558.471035:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140097152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241558.471118:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241558.471176:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241558.471215:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140097152 00000100:00100000:0.0:1782241558.471224:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140097152 00000100:00100000:0.0:1782241558.471288:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782241558.471298:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+11:22609:x1868815140097152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241558.471311:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241558.471325:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4499b200/0xc9959f2fb1e1b1f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b1ea expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241558.471359:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499b200/0xc9959f2fb1e1b1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b1ea expref: 12 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241558.471371:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4499b200/0xc9959f2fb1e1b1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b1ea expref: 12 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241558.471393:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499b200, rc 0) 00000100:00100000:0.0:1782241558.471434:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22609:x1868815140097152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241558.471441:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782241558.471866:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140097152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241558.471883:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241558.471891:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241558.471945:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140097280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782241558.471980:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241558.472629:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241558.474239:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140097280 00000100:00100000:0.0:1782241558.474256:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140097280 00000100:00100000:0.0:1782241558.474362:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782241558.474372:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22609:x1868815140097280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782241558.474399:0:22605:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782241558.474418:0:22605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782241558.474422:0:22605:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1782241558.474563:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:22609:x1868815140097280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 192us (2582us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241558.474571:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782241558.474592:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140097280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782241558.474647:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782241558.474656:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241558.474666:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782241558.726795:0:22647:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782241558.726806:0:22647:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782241558.728422:0:22647:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782241558.728435:0:22647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1782241558.788866:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00010000:00010000:3.0:1782241559.302013:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782241559.749295:0:22647:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782241559.749317:0:22647:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782241559.749442:0:22647:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1782241559.749479:0:22647:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782241559.749630:0:22647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:1.0:1782241559.813918:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00010000:00010000:1.0:1782241560.327617:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241560.837078:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00010000:00010000:3.0:1782241561.359602:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241561.866831:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00000001:02000400:0.0:1782241562.254988:0:22896:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782241562.374797:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241562.893369:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00000100:00100000:3.0:1782241562.896060:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23eacdb9-0e56-4c3a-b421-5efac43515c0:3640:1868815140097408:0@lo:400:kworker.0 00000100:00100000:3.0:1782241562.896138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241562.896426:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140097408 00000100:00100000:2.0:1782241562.896445:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140097408 00000100:00100000:2.0:1782241562.896518:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782241562.896530:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:3640:x1868815140097408:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782241562.896595:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782241562.896601:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1782241562.896604:0:36:0:(import.c:65:import_set_state_nolock()) ffff890e7c699800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241562.896610:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 620 00000100:00080000:1.0:1782241562.896614:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782241562.896619:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff890e7c699800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241562.896644:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48039f80 x1868815140097536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241562.896661:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241562.896665:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782241562.896668:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241562.896670:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782241562.896672:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782241562.896675:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782241562.896681:0:36:0:(import.c:65:import_set_state_nolock()) ffff890d48030000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241562.896686:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff890d48030000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241562.896700:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48039c00 x1868815140097664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782241562.896745:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140097536:0@lo:38:kworker.0 00000100:00100000:1.0:1782241562.896817:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241562.896839:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140097664:0@lo:38:kworker.0 00000100:00100000:1.0:1782241562.896889:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241562.896930:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140097536 00000100:00100000:1.0:1782241562.896934:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140097536 00000100:00100000:1.0:1782241562.896955:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241562.896960:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1868815140097536:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1782241562.896977:0:22617:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782241562.897009:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1868815140097536:12345-0@lo:38:kworker.0 Request processed in 47us (191us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782241562.897016:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241562.897058:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140097664 00000100:00100000:1.0:1782241562.897061:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140097664 00000100:00100000:1.0:1782241562.897081:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241562.897086:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1868815140097664:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1782241562.897102:0:22613:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:1.0:1782241562.897138:0:22613:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc9959f2fb1e1b1f8 00000004:00100000:1.0:1782241562.897154:0:22613:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782241562.899409:0:22613:0:(import.c:65:import_set_state_nolock()) ffff890d48031800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241562.899506:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1868815140097664:12345-0@lo:38:kworker.0 Request processed in 2403us (2601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241562.899526:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1782241562.899597:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7c699800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241562.899602:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782241562.899606:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140097536:0@lo:38:kworker.0 00010000:00080000:1.0:1782241562.899621:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff890d48039c00 x1868815140097664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782241562.899635:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1782241562.899644:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782241562.899650:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782241562.899652:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48030000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782241562.899657:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140097664:0@lo:38:kworker.0 00000100:00100000:2.0:1782241562.900601:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:3640:x1868815140097408:12345-0@lo:400:kworker.0 Request processed in 4069us (4458us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241562.900613:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782241562.901524:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23eacdb9-0e56-4c3a-b421-5efac43515c0:3640:1868815140097408:0@lo:400:kworker.0 00000020:00000004:3.0:1782241563.168901:0:22948:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241563.169304:0:22948:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782241563.397101:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241563.909076:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00000020:00000004:3.0:1782241564.016294:0:22998:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241564.023512:0:22998:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782241564.421098:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241564.935034:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00010000:00010000:3.0:1782241565.444906:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241565.956851:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00010000:00010000:0.0:1782241566.469235:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241566.981133:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00010000:00010000:2.0:1782241567.495264:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241568.007888:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241557/real 1782241557] req@ffff890e778ddf80 x1868815140094592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241567 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241568.007927:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e778ddf80 x1868815140094592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241567 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241568.007939:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241557/real 1782241557] req@ffff890e7f685f80 x1868815140094464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241567 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241568.007952:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e7f685f80 x1868815140094464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241567 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782241568.007973:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48885000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241568.007995:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782241568.008002:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140094592:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1782241568.008008:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d47b7a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241568.008011:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782241568.008015:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140094464:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1782241568.008171:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1782241568.008177:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1782241568.008180:0:8:0:(import.c:65:import_set_state_nolock()) ffff890e7c699800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241568.008186:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 626 00000100:00080000:0.0:1782241568.008200:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1782241568.008209:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff890e7c699800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241568.008233:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e778de680 x1868815140097920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241568.008246:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241568.008254:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782241568.008256:0:8:0:(import.c:65:import_set_state_nolock()) ffff890d47b7a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241568.008260:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 620 00000100:00080000:0.0:1782241568.008262:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782241568.008266:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff890d47b7a800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241568.008276:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e778df100 x1868815140098048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241568.008285:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241568.008288:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782241568.008289:0:8:0:(import.c:65:import_set_state_nolock()) ffff890d48885000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241568.008292:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 620 00000100:00080000:0.0:1782241568.008294:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782241568.008296:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff890d48885000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241568.008305:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e778df480 x1868815140098176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241568.008368:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815140098304:0@lo:400:kworker.0 00000100:00100000:0.0:1782241568.008476:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241568.008526:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241568.008531:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23eacdb9-0e56-4c3a-b421-5efac43515c0:3638:1868815140097792:0@lo:400:kworker.0 00000100:00100000:0.0:1782241568.008559:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241568.008600:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140098304 00000100:00100000:0.0:1782241568.008608:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140098304 00000100:00100000:0.0:1782241568.008654:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782241568.008663:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815140098304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241568.008714:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815140098304:12345-0@lo:400:kworker.0 Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241568.008727:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782241568.008753:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140097792 00000100:00100000:0.0:1782241568.008780:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140097792 00000100:00100000:0.0:1782241568.008805:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782241568.008811:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:3638:x1868815140097792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241568.008839:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:3638:x1868815140097792:12345-0@lo:400:kworker.0 Request processed in 28us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241568.008845:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782241568.008895:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23eacdb9-0e56-4c3a-b421-5efac43515c0:3638:1868815140097792:0@lo:400:kworker.0 00010000:00080000:0.0:1782241568.008907:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff890e778dea00 x1868815140098304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241568.008918:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815140098304:0@lo:400:kworker.0 00000100:00100000:0.0:1782241568.008941:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140097920:0@lo:38:kworker.0 00000100:00100000:0.0:1782241568.008968:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241568.008983:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140098048:0@lo:8:kworker.0 00000400:00000100:0.0:1782241568.009000:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140098048 offset 0 length 520: 4 00000100:00100000:0.0:1782241568.009014:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140098176:0@lo:8:kworker.0 00000400:00000100:0.0:1782241568.009029:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140098176 offset 0 length 520: 4 00000100:00100000:1.0:1782241568.009177:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140097920 00000100:00100000:1.0:1782241568.009181:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140097920 00000100:00100000:1.0:1782241568.009217:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241568.009223:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1868815140097920:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1782241568.009242:0:22617:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782241568.009277:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1868815140097920:12345-0@lo:38:kworker.0 Request processed in 54us (309us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782241568.009283:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1782241568.012256:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7c699800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241568.012274:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782241568.012279:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140097920:0@lo:38:kworker.0 00000100:00100000:1.0:1782241568.019937:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00010000:00010000:0.0:1782241568.517529:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241569.033439:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00010000:00010000:2.0:1782241569.542230:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782241569.997112:0:22647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782241570.053022:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00010000:00010000:0.0:1782241570.570154:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782241571.062976:0:23344:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782241571.062980:0:23344:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1782241571.062982:0:23344:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1782241571.063623:0:23344:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff890d46921800 00000020:01000004:0.0:1782241571.063639:0:23344:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1782241571.063651:0:23344:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1782241571.063664:0:23344:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff890d46744d40) 00000020:00000080:0.0:1782241571.063680:0:23344:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1782241571.078876:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00100000:10000000:3.0:1782241571.144696:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1782241571.148450:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1782241571.149738:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1782241571.150222:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1782241571.150422:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1782241571.150688:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1782241571.150893:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1782241571.151427:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1782241571.151640:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1782241571.156869:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1782241571.157154:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1782241571.157463:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1782241571.157741:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1782241571.158056:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1782241571.158612:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1782241571.159199:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1782241571.159596:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1782241571.159857:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1782241571.160057:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1782241571.161318:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1782241571.162058:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1782241571.162938:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1782241571.164285:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1782241571.167879:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1782241571.168405:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1782241571.168712:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1782241571.169080:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1782241571.169387:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1782241571.170224:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1782241571.170603:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1782241571.170874:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1782241571.171231:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1782241571.171640:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1782241571.171961:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1782241571.175160:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1782241571.176678:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1782241571.179150:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1782241571.180249:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1782241571.180711:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1782241571.181175:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1782241571.181432:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1782241571.181750:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1782241571.182050:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1782241571.182299:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1782241571.182591:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1782241571.184919:0:23344:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:2.0:1782241571.195257:0:23344:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782241571.195497:0:23344:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1782241571.195522:0:23344:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782241571.195535:0:23344:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1b206 00000020:01000004:2.0:1782241571.195542:0:23344:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1782241571.195564:0:23344:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782241571.195568:0:23344:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782241571.195574:0:23344:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1782241571.195600:0:23344:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1782241571.195605:0:23344:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1782241571.215381:0:23344:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782241571.215441:0:23344:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.158@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1782241571.215445:0:23344:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782241571.215447:0:23344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782241571.215449:0:23344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241571.215450:0:23344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241571.215451:0:23344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241571.215453:0:23344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241571.215454:0:23344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241571.215456:0:23344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241571.215457:0:23344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782241571.215461:0:23344:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1782241571.215464:0:23344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782241571.215465:0:23344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782241571.215466:0:23344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241571.215467:0:23344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241571.215468:0:23344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241571.215475:0:23344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241571.215476:0:23344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241571.215477:0:23344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241571.215478:0:23344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782241571.215518:0:23344:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1782241571.215540:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140098432:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782241571.215621:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.215664:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51a50d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782241571.215917:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140098432 00000100:00100000:2.0:1782241571.215925:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140098432 00000100:00100000:2.0:1782241571.216018:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782241571.216037:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:23344:x1868815140098432:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782241571.216071:0:22606:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782241571.216075:0:22606:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1782241571.216084:0:22606:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1782241571.225082:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:23344:x1868815140098432:12345-0@lo:253:mount.lustre.0 Request processed in 9038us (9455us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241571.225113:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782241571.225228:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140098432:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782241571.225243:0:23344:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1782241571.225246:0:23344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782241571.225248:0:23344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782241571.225249:0:23344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241571.225250:0:23344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241571.225251:0:23344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241571.225253:0:23344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241571.225254:0:23344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241571.225256:0:23344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241571.225257:0:23344:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782241571.225277:0:23344:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890d46921800 from lustre-MDT0001 10000000:01000000:3.0:1782241571.225308:0:23344:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1782241571.225311:0:23344:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1782241571.225317:0:23344:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff890e77d999c0 local copy 00010000:00010000:3.0:1782241571.225338:0:23344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241571.225447:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140098560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241571.225482:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.233566:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51a500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241571.239752:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140098560 00000100:00100000:0.0:1782241571.239780:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140098560 00000100:00100000:0.0:1782241571.239985:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782241571.239996:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:23344:x1868815140098560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241571.240257:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:23344:x1868815140098560:12345-0@lo:501:mount.lustre.0 Request processed in 262us (14773us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782241571.240267:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782241571.240414:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140098560:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782241571.240438:0:23344:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782241571.240464:0:23344:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782241571.240485:0:23344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.240496:0:23344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241571.240599:0:23344:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890d46921800 10000000:01000000:3.0:1782241571.240604:0:23344:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782241571.240610:0:23344:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff890e77d999c0 10000000:01000000:3.0:1782241571.240612:0:23344:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1782241571.240615:0:23344:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff890e77d999c0 from 1 10000000:01000000:3.0:1782241571.240618:0:23344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782241571.240649:0:23344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e1b20d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.240657:0:23344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e1b20d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.240665:0:23344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e1b20d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241571.240686:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140098688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782241571.240720:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.240852:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51a500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241571.240960:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140098688 00000100:00100000:0.0:1782241571.240969:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140098688 00000100:00100000:0.0:1782241571.240989:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782241571.240994:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+12:23344:x1868815140098688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241571.241003:0:22605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241571.241014:0:22605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1b214 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b20d expref: -99 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.241111:0:22605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1b214 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b20d expref: 13 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.241122:0:22605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1b214 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b20d expref: 13 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.241131:0:22605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a600, rc 0) 00000100:00100000:0.0:1782241571.241172:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+13:23344:x1868815140098688:12345-0@lo:101:mount.lustre.0 Request processed in 176us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241571.241178:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782241571.241298:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140098688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241571.241310:0:23344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e1b20d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b214 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.241319:0:23344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e1b20d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b214 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241571.241352:0:23344:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782241571.241364:0:23344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e1b20d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b214 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.241371:0:23344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e1b20d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b214 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241571.241379:0:23344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff890d46921800 10000000:01000000:3.0:1782241571.241383:0:23344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1782241571.241387:0:23344:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff890d46921800 from 1 10000000:01000000:3.0:1782241571.241389:0:23344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1782241571.241403:0:23344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d200/0xc9959f2fb1e1b21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.241411:0:23344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164d200/0xc9959f2fb1e1b21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.241419:0:23344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164d200/0xc9959f2fb1e1b21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241571.241431:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140098816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782241571.241457:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.241483:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51a500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241571.241597:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140098816 00000100:00100000:0.0:1782241571.241602:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140098816 00000100:00100000:0.0:1782241571.241628:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782241571.241635:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+13:23344:x1868815140098816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241571.241643:0:22605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241571.241652:0:22605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4499a000/0xc9959f2fb1e1b222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b21b expref: -99 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.241665:0:22605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499a000/0xc9959f2fb1e1b222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b21b expref: 14 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.241672:0:22605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4499a000/0xc9959f2fb1e1b222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b21b expref: 14 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.241683:0:22605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a000, rc 0) 00000100:00100000:0.0:1782241571.241714:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+14:23344:x1868815140098816:12345-0@lo:101:mount.lustre.0 Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241571.241720:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782241571.242070:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140098816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241571.242082:0:23344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164d200/0xc9959f2fb1e1b21b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b222 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.242346:0:23344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164d200/0xc9959f2fb1e1b21b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b222 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241571.242365:0:23344:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1782241571.242384:0:23344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d200/0xc9959f2fb1e1b21b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b222 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.242391:0:23344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164d200/0xc9959f2fb1e1b21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b222 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241571.242398:0:23344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1782241571.242403:0:23344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782241571.242407:0:23344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff890d46921800 10000000:01000000:3.0:1782241571.242410:0:23344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1782241571.242413:0:23344:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1782241571.242415:0:23344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1782241571.242435:0:23344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1b229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.242443:0:23344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1b229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.242451:0:23344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1b229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241571.242465:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140098944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782241571.242496:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.242533:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51a500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241571.242671:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140098944 00000100:00100000:1.0:1782241571.242677:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140098944 00000100:00100000:1.0:1782241571.242712:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782241571.242720:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+14:23344:x1868815140098944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241571.242728:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241571.242738:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e7c310e00/0xc9959f2fb1e1b230 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b229 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.242791:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c310e00/0xc9959f2fb1e1b230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b229 expref: 15 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.242800:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e7c310e00/0xc9959f2fb1e1b230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b229 expref: 15 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.242807:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c310e00, rc 0) 00000100:00100000:1.0:1782241571.242838:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+15:23344:x1868815140098944:12345-0@lo:101:mount.lustre.0 Request processed in 119us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241571.242844:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782241571.243087:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140098944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241571.243099:0:23344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1b229 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b230 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.243111:0:23344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1b229 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b230 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782241571.244771:0:23344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1782241571.245986:0:23344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241571.258604:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1782241571.258662:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1782241571.258675:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1782241571.258686:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1782241571.258697:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1782241571.258708:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1782241571.258719:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1782241571.258729:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1782241571.258739:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1782241571.258749:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1782241571.258775:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1782241571.258788:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1782241571.258802:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1782241571.258814:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1782241571.258850:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1782241571.258863:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1782241571.258874:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1782241571.258887:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1782241571.258899:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1782241571.258912:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1782241571.258923:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1782241571.258934:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1782241571.258944:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1782241571.258956:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1782241571.258966:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1782241571.258976:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1782241571.258995:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1782241571.259006:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1782241571.259017:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1782241571.259027:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1782241571.259047:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1782241571.259058:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1782241571.259069:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1782241571.259080:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1782241571.259090:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1782241571.259101:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1782241571.259111:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1782241571.259121:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1782241571.259132:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1782241571.259143:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1782241571.259154:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1782241571.259164:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1782241571.259175:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1782241571.262612:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1782241571.262678:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1782241571.262685:0:23344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1782241571.262821:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140099072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241571.262885:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.262930:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51a503c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241571.262954:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140099072 00000100:00100000:1.0:1782241571.262963:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140099072 00000100:00100000:1.0:1782241571.263014:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782241571.263029:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+15:23344:x1868815140099072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241571.263193:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+15:23344:x1868815140099072:12345-0@lo:501:mount.lustre.0 Request processed in 171us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241571.263201:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782241571.263970:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140099072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241571.264025:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140099200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241571.264085:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241571.264125:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241571.264894:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140099200 00000100:00100000:2.0:1782241571.264903:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140099200 00000100:00100000:2.0:1782241571.264958:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782241571.264967:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+15:23344:x1868815140099200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782241571.266903:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+15:23344:x1868815140099200:12345-0@lo:503:mount.lustre.0 Request processed in 1930us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241571.266917:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782241571.271039:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140099200:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782241571.276943:0:23344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241571.277084:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140099328:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241571.277162:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241571.277212:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241571.277319:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140099328 00000100:00100000:2.0:1782241571.277345:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140099328 00000100:00100000:2.0:1782241571.277394:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782241571.277404:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+15:23344:x1868815140099328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241571.278712:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+15:23344:x1868815140099328:12345-0@lo:502:mount.lustre.0 Request processed in 1306us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241571.278723:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782241571.278824:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140099328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241571.279039:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1782241571.279071:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1782241571.279085:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1782241571.279100:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1782241571.279114:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1782241571.279126:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1782241571.279138:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1782241571.279163:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1782241571.279177:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1782241571.279221:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1782241571.279235:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1782241571.279247:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1782241571.279262:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1782241571.279276:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1782241571.279289:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1782241571.279302:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1782241571.279314:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1782241571.279338:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1782241571.279353:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1782241571.279377:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1782241571.279392:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1782241571.279406:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1782241571.279418:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1782241571.279431:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1782241571.279446:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1782241571.279469:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1782241571.279498:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1782241571.279513:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1782241571.279527:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1782241571.279540:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1782241571.279554:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1782241571.279567:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1782241571.279581:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1782241571.279595:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1782241571.279608:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1782241571.279620:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1782241571.279635:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1782241571.279649:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1782241571.279663:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1782241571.279677:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1782241571.279699:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1782241571.279725:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1782241571.279740:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1782241571.279753:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1782241571.279831:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140099456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241571.279884:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.279915:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51a500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241571.280665:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140099456 00000100:00100000:0.0:1782241571.280674:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140099456 00000100:00100000:0.0:1782241571.280733:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782241571.280742:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+15:23344:x1868815140099456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241571.280881:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+15:23344:x1868815140099456:12345-0@lo:502:mount.lustre.0 Request processed in 140us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241571.280889:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782241571.283478:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140099456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782241571.283649:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1782241571.283665:0:23344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1782241571.284733:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241571.284744:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241571.284747:0:23348:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1782241571.284753:0:23348:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1782241571.284873:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782241571.284889:0:23348:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff890e43630000) 00000020:00000080:2.0:1782241571.284909:0:23348:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1782241571.284915:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1782241571.285005:0:23348:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782241571.285013:0:23348:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1b23e 00000020:00000080:2.0:1782241571.285300:0:23348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1782241571.285310:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241571.285313:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241571.285314:0:23348:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1782241571.285317:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241571.285320:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241571.285399:0:23348:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1782241571.285405:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782241571.285414:0:23348:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff890e81744d40) 00000020:00000080:2.0:1782241571.285426:0:23348:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1782241571.285430:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1782241571.285432:0:23348:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1782241571.285436:0:23348:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1782241571.285442:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782241571.285488:0:23348:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890d46921800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1782241571.285499:0:23348:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff890e81743380) 00000020:00000080:2.0:1782241571.285573:0:23348:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1782241571.285645:0:23348:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1782241571.285650:0:23348:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1b253 00000020:00000080:2.0:1782241571.285753:0:23348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1782241571.285898:0:23348:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1782241571.285903:0:23348:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc9959f2fb1e1b25a 00080000:01000000:2.0:1782241571.285910:0:23348:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1782241571.285914:0:23348:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1b261 00010000:00010000:2.0:1782241571.411521:0:23348:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1782241571.413220:0:23348:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1782241571.414993:0:23348:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782241571.420249:0:23348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1782241571.420264:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241571.420272:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.420275:0:23348:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1782241571.420279:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241571.420287:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.420288:0:23348:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1782241571.420292:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782241571.420298:0:23348:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:00000080:3.0:1782241571.420341:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782241571.420356:0:23348:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff890e81fccd40) 00000020:00000080:3.0:1782241571.420382:0:23348:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1782241571.420388:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782241571.420485:0:23348:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1782241571.420493:0:23348:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1782241571.420500:0:23348:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1b26f 00010000:00080000:3.0:1782241571.420533:0:23348:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d480ca000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.158@tcp at head 00010000:00010000:2.0:1782241571.423161:0:23348:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1782241571.425477:0:23348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1782241571.425494:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1782241571.425532:0:23348:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1782241571.425558:0:23348:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1b276 00000100:00080000:3.0:1782241571.425569:0:23348:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782241571.425584:0:23348:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff890d480ca000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241571.425623:0:23348:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7d637480 x1868815140099584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241571.425653:0:23348:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1782241571.425712:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241571.425717:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.425718:0:23348:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1782241571.425721:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782241571.425724:0:23348:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1782241571.425726:0:23348:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782241571.425728:0:23348:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782241571.425729:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782241571.425732:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.425733:0:23348:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782241571.425735:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241571.425740:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.425741:0:23348:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1782241571.425745:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1782241571.425800:0:23348:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1782241571.425814:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241571.425818:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.425819:0:23348:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1782241571.425822:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782241571.425823:0:23348:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1782241571.425825:0:23348:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782241571.425826:0:23348:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782241571.425828:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782241571.425830:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.425832:0:23348:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782241571.425834:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782241571.425837:0:23348:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1782241571.425840:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.425847:0:23348:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1782241571.425851:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782241571.425855:0:23348:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:3.0:1782241571.425880:0:23348:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1782241571.425882:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782241571.425895:0:23348:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff890e43fe8000) 00000020:00000080:3.0:1782241571.425907:0:23348:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1782241571.425912:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782241571.425966:0:23348:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1782241571.425973:0:23348:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782241571.425980:0:23348:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1b284 00010000:00080000:3.0:1782241571.426010:0:23348:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e436dd800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.158@tcp at head 00000100:00100000:0.0:1782241571.426246:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140099584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782241571.426315:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241571.426538:0:23348:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1782241571.426855:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1782241571.426861:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1782241571.426864:0:36:0:(import.c:65:import_set_state_nolock()) ffff890e7c699800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241571.426869:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:2.0:1782241571.426880:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1782241571.426885:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff890e7c699800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241571.426906:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f684700 x1868815140099712/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241571.426919:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241571.426923:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241571.426925:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241571.426928:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782241571.427099:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140099840:0@lo:400:kworker.0 00000100:00100000:3.0:1782241571.427151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.427214:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140099840 00000100:00100000:3.0:1782241571.427221:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140099840 00000100:00100000:3.0:1782241571.427265:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782241571.427274:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140099840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241571.427346:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140099840:12345-0@lo:400:kworker.0 Request processed in 72us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241571.427354:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782241571.428056:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff890e7f687800 x1868815140099840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000040:01000000:2.0:1782241571.428060:0:23348:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1782241571.428075:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140099840:0@lo:400:kworker.0 00000100:00100000:0.0:1782241571.432963:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140099712:0@lo:38:kworker.0 00000100:00100000:0.0:1782241571.433057:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241571.433102:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140099584 00000100:00100000:0.0:1782241571.433110:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140099584 00000100:00100000:0.0:1782241571.433133:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140099712 00000100:00100000:0.0:1782241571.433136:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140099712 00000100:00100000:0.0:1782241571.433148:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241571.433155:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140099584:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1782241571.433182:0:22616:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:0.0:1782241571.433217:0:22616:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1b28b 00000040:01000000:3.0:1782241571.433226:0:23348:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000004:00100000:0.0:1782241571.433233:0:22616:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1782241571.433240:0:22616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:3.0:1782241571.435886:0:23348:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241571.436276:0:23348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1782241571.436419:0:23348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1782241571.440409:0:23353:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1782241571.440418:0:23353:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1782241571.447498:0:23348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1782241571.447514:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782241571.447558:0:23348:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782241571.447580:0:23348:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1b292 00000100:00080000:1.0:1782241571.447591:0:23348:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241571.447597:0:23348:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff890e436dd800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241571.447630:0:23348:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48039c00 x1868815140099968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241571.447659:0:23348:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1782241571.447723:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241571.447729:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241571.447733:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000000:1.0:1782241571.447733:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:3.0:1782241571.447739:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1782241571.447740:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241571.447744:0:23348:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1782241571.447748:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782241571.447751:0:23348:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1782241571.447753:0:23348:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:0.0:1782241571.447926:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140099968:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1782241571.447997:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140099968 offset 0 length 520: 4 00000100:00080000:0.0:1782241571.451945:0:22616:0:(import.c:65:import_set_state_nolock()) ffff890e77a77000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782241571.452050:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1868815140099584:12345-0@lo:38:llog_process_th.0 Request processed in 18892us (25733us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241571.452061:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241571.452102:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782241571.452111:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1782241571.452120:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1782241571.452125:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782241571.452128:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d480ca000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782241571.452140:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140099584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782241571.452168:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782241571.452189:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140099712:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1782241571.452253:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140099712:12345-0@lo:38:kworker.0 Request processed in 77us (19196us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782241571.452259:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782241571.452281:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782241571.452286:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7c699800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241571.452290:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782241571.452293:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140099712:0@lo:38:kworker.0 00000100:00100000:3.0:1782241571.452484:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140100096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241571.452546:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241571.452904:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140100096 00000100:00100000:0.0:1782241571.452911:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140100096 00000100:00100000:0.0:1782241571.452948:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782241571.452954:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1868815140100096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241571.452978:0:22617:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1782241571.453015:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1868815140100096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241571.453021:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782241571.454831:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140100096:0@lo:41:osp-pre-0-1.0 00000020:01000000:1.0:1782241571.456599:0:23348:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782241571.456604:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782241571.456615:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241571.456618:0:23348:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782241571.456625:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782241571.456631:0:23348:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1782241571.456634:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241571.456636:0:23348:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782241571.456639:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782241571.456645:0:23348:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:1.0:1782241571.456674:0:23348:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1782241571.456677:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241571.456693:0:23348:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff890e503f4d40) 00000020:00000080:1.0:1782241571.456715:0:23348:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1782241571.456720:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782241571.456933:0:23348:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1782241571.456941:0:23348:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782241571.456948:0:23348:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1b2a0 00010000:00080000:1.0:1782241571.456981:0:23348:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e449fb000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241571.457502:0:23348:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1782241571.457576:0:23348:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782241571.457590:0:23348:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1782241571.462165:0:23348:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241571.465680:0:23348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1782241571.467139:0:23348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1782241571.469277:0:23355:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1782241571.469286:0:23355:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1782241571.471652:0:23348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782241571.471672:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782241571.471721:0:23348:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1782241571.471745:0:23348:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1b2a7 00000100:00080000:2.0:1782241571.471789:0:23348:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782241571.471796:0:23348:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890e449fb000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241571.471834:0:23348:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f684a80 x1868815140100224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241571.471854:0:23348:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1782241571.471915:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241571.471920:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241571.471922:0:23348:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1782241571.471925:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241571.471929:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241571.471931:0:23348:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782241571.471934:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782241571.471941:0:23348:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782241571.471944:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241571.471946:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241571.471948:0:23348:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1782241571.471950:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241571.471952:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241571.471954:0:23348:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782241571.471958:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1782241571.471986:0:23348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241571.471990:0:23348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241571.471991:0:23348:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782241571.471995:0:23348:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:3.0:1782241571.472287:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241571.472292:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241571.472296:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241571.472298:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1782241571.472330:0:23344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1782241571.472361:0:23344:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1782241571.472378:0:23344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1b229 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b230 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.472391:0:23344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1b229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b230 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241571.472399:0:23344:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d46921800 from 1 10000000:01000000:3.0:1782241571.472403:0:23344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782241571.472432:0:23344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241571.472435:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140100224:0@lo:8:llog_process_th.0 00010000:00010000:3.0:1782241571.472451:0:23344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.472505:0:23344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:0.0:1782241571.472521:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140100224 offset 0 length 520: 4 00000100:00100000:3.0:1782241571.472526:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782241571.472574:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.472592:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869300 going to sleep for 11 seconds 00000100:00100000:0.0:1782241571.472596:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140100352 00000100:00100000:0.0:1782241571.472604:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140100352 00000100:00100000:0.0:1782241571.472659:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782241571.472669:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+15:23344:x1868815140100352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241571.472684:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241571.472697:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b2b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b2ae expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.472721:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b2ae expref: 16 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.472740:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b2ae expref: 16 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.472750:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499be00, rc 0) 00000100:00100000:0.0:1782241571.472831:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+16:23344:x1868815140100352:12345-0@lo:101:mount.lustre.0 Request processed in 162us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241571.472838:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782241571.472884:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241571.472898:0:23344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.472908:0:23344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241571.474618:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100480:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1782241571.475390:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.475467:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869300 going to sleep for 11 seconds 00000100:00100000:2.0:1782241571.475598:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140100480 00000100:00100000:2.0:1782241571.475606:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140100480 00000100:00100000:2.0:1782241571.475689:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782241571.475698:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+16:23344:x1868815140100480:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1782241571.475721:0:22604:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1782241571.475742:0:22604:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782241571.475745:0:22604:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1782241571.475864:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+16:23344:x1868815140100480:12345-0@lo:256:mount.lustre.0 Request processed in 167us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241571.475871:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782241571.475920:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100480:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1782241571.476916:0:23344:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782241571.476941:0:23344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.476953:0:23344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241571.476963:0:23344:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d46921800 from 1 10000000:01000000:0.0:1782241571.476966:0:23344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782241571.477001:0:23344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.477010:0:23344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.477021:0:23344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241571.477040:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782241571.477096:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241571.477140:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782241571.477459:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140100608 00000100:00100000:2.0:1782241571.477465:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140100608 00000100:00100000:2.0:1782241571.477648:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782241571.477657:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+16:23344:x1868815140100608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241571.477669:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241571.477681:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b2c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b2bc expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241571.477702:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b2bc expref: 17 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241571.477718:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b2bc expref: 17 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241571.477727:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43face00, rc 0) 00000100:00100000:2.0:1782241571.477846:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:23344:x1868815140100608:12345-0@lo:101:mount.lustre.0 Request processed in 189us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241571.477853:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782241571.477975:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241571.477991:0:23344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.477999:0:23344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782241571.482621:0:23344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1782241571.482948:0:23344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782241571.483143:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1782241571.483168:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1782241571.483211:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1782241571.483227:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1782241571.483239:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1782241571.483252:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1782241571.483265:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1782241571.483277:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1782241571.483290:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1782241571.483925:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1782241571.483940:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1782241571.483958:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1782241571.483962:0:23344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1782241571.484042:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241571.484109:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241571.484147:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85540 going to sleep for 11 seconds 00000100:00100000:2.0:1782241571.484683:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140100736 00000100:00100000:2.0:1782241571.484692:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140100736 00000100:00100000:2.0:1782241571.484747:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782241571.484784:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:23344:x1868815140100736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241571.484906:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:23344:x1868815140100736:12345-0@lo:501:mount.lustre.0 Request processed in 151us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241571.484914:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241571.485158:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241571.485197:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241571.485238:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.485269:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869240 going to sleep for 11 seconds 00000100:00100000:0.0:1782241571.485679:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140100864 00000100:00100000:0.0:1782241571.485685:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140100864 00000100:00100000:0.0:1782241571.486286:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782241571.486316:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:23344:x1868815140100864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241571.486449:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:23344:x1868815140100864:12345-0@lo:503:mount.lustre.0 Request processed in 136us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241571.486457:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782241571.486627:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100864:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782241571.487144:0:23344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782241571.487228:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241571.487318:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241571.492832:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e7d618000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241571.493686:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140100992 00000100:00100000:2.0:1782241571.493903:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140100992 00000100:00100000:2.0:1782241571.493964:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782241571.493973:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:23344:x1868815140100992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241571.494165:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:23344:x1868815140100992:12345-0@lo:502:mount.lustre.0 Request processed in 191us (6846us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241571.494172:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782241571.499915:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140100992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782241571.500266:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1782241571.500317:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1782241571.500346:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1782241571.500359:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1782241571.500372:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1782241571.500396:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1782241571.500411:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1782241571.500426:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1782241571.500440:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1782241571.500453:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1782241571.500469:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1782241571.500510:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241571.500581:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241571.500689:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4c5cc780 going to sleep for 11 seconds 00000100:00100000:0.0:1782241571.500998:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140101120 00000100:00100000:0.0:1782241571.501005:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140101120 00000100:00100000:0.0:1782241571.501086:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782241571.501096:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:23344:x1868815140101120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241571.501222:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:23344:x1868815140101120:12345-0@lo:502:mount.lustre.0 Request processed in 128us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241571.501229:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782241571.501317:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241571.501384:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1782241571.501399:0:23344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1782241571.501967:0:23357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241571.501976:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.501978:0:23357:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782241571.501986:0:23357:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890d46921800 00000020:00000080:3.0:1782241571.501989:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782241571.501996:0:23357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241571.501998:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.502000:0:23357:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1782241571.502002:0:23357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241571.502004:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.502006:0:23357:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782241571.502009:0:23357:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890d46921800 00000020:00000080:3.0:1782241571.502011:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782241571.502059:0:23357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241571.503436:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.503443:0:23357:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1782241571.503455:0:23357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241571.503462:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241571.503463:0:23357:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782241571.503469:0:23357:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890d46921800 00000020:00000080:3.0:1782241571.503472:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782241571.503518:0:23357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241571.503802:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241571.503805:0:23357:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782241571.503809:0:23357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241571.503812:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241571.503813:0:23357:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1782241571.503817:0:23357:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890d46921800 00000020:00000080:2.0:1782241571.503821:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782241571.503867:0:23357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241571.503871:0:23357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241571.503873:0:23357:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1782241571.503881:0:23357:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1782241571.504056:0:23344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1782241571.504098:0:23344:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782241571.504150:0:23344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.504164:0:23344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241571.504217:0:23344:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782241571.504220:0:23344:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890d46921800 10000000:01000000:0.0:1782241571.504223:0:23344:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890d46921800 10000000:01000000:0.0:1782241571.504227:0:23344:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782241571.504233:0:23344:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890d46921800 from 1 10000000:01000000:0.0:1782241571.504235:0:23344:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782241571.504272:0:23344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4499a800/0xc9959f2fb1e1b2ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.504281:0:23344:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4499a800/0xc9959f2fb1e1b2ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.504309:0:23344:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4499a800/0xc9959f2fb1e1b2ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241571.504342:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782241571.504415:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241571.504453:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782241571.505469:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140101248 00000100:00100000:3.0:1782241571.505480:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140101248 00000100:00100000:3.0:1782241571.505580:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782241571.505591:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:23344:x1868815140101248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241571.505607:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241571.505621:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164ca00/0xc9959f2fb1e1b2d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b2ca expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.505646:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164ca00/0xc9959f2fb1e1b2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b2ca expref: 18 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.505665:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164ca00/0xc9959f2fb1e1b2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b2ca expref: 18 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.505675:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164ca00, rc 0) 00000100:00100000:3.0:1782241571.505732:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140101248:12345-0@lo:101:mount.lustre.0 Request processed in 143us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241571.505739:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782241571.505957:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241571.505976:0:23344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4499a800/0xc9959f2fb1e1b2ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2d1 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241571.505986:0:23344:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4499a800/0xc9959f2fb1e1b2ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b2d1 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782241571.507570:0:23344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1782241571.507907:0:23344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241571.508080:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1782241571.508104:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1782241571.508119:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1782241571.508132:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1782241571.508160:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1782241571.508176:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1782241571.508189:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1782241571.508201:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1782241571.508214:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1782241571.508226:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1782241571.508238:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1782241571.508249:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1782241571.508271:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1782241571.508284:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1782241571.508304:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1782241571.508317:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1782241571.508343:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1782241571.508358:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1782241571.508370:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1782241571.508381:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1782241571.508475:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1782241571.508492:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1782241571.508576:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1782241571.508593:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1782241571.508606:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1782241571.508618:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1782241571.508630:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1782241571.508642:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1782241571.508655:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1782241571.508668:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1782241571.508680:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1782241571.508692:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1782241571.508704:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1782241571.508716:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1782241571.508727:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1782241571.508739:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1782241571.508840:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1782241571.508856:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1782241571.508868:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1782241571.508879:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1782241571.508891:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1782241571.508903:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1782241571.508915:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1782241571.508927:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1782241571.508939:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1782241571.508960:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1782241571.508972:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1782241571.508983:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1782241571.509087:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1782241571.509105:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1782241571.509122:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1782241571.509127:0:23344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1782241571.509213:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241571.509274:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.509423:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241571.509592:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140101376 00000100:00100000:1.0:1782241571.509600:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140101376 00000100:00100000:1.0:1782241571.509647:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782241571.509656:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140101376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241571.509793:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140101376:12345-0@lo:501:mount.lustre.0 Request processed in 137us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241571.509801:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782241571.509901:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241571.509930:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241571.509962:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241571.509975:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241571.509989:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140101504 00000100:00100000:3.0:1782241571.509992:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140101504 00000100:00100000:3.0:1782241571.510014:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241571.510021:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140101504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241571.510089:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140101504:12345-0@lo:503:mount.lustre.0 Request processed in 67us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241571.510096:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241571.510133:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101504:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782241571.510636:0:23344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782241571.510704:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241571.510739:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241571.510807:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140101632 00000100:00100000:1.0:1782241571.510812:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140101632 00000100:00100000:3.0:1782241571.510865:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241571.511339:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782241571.511348:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140101632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241571.511457:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140101632:12345-0@lo:502:mount.lustre.0 Request processed in 109us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241571.511464:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782241571.513561:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782241571.513810:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1782241571.513842:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1782241571.513857:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1782241571.513870:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1782241571.513883:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1782241571.513896:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1782241571.513910:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1782241571.513925:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1782241571.513938:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1782241571.513963:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1782241571.513985:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1782241571.513998:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1782241571.514011:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1782241571.514024:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1782241571.514035:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1782241571.514047:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1782241571.514059:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1782241571.514072:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1782241571.514085:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1782241571.514097:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1782241571.514109:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1782241571.514122:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1782241571.514135:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1782241571.514148:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1782241571.514160:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1782241571.514185:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1782241571.514200:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1782241571.514212:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1782241571.514225:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1782241571.514237:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1782241571.514251:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1782241571.514264:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1782241571.514276:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1782241571.514287:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1782241571.514299:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1782241571.514310:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1782241571.514334:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1782241571.514348:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1782241571.514360:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1782241571.514372:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1782241571.514383:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1782241571.514419:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1782241571.514436:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1782241571.514458:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1782241571.514619:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1782241571.516093:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1782241571.516121:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1782241571.516135:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1782241571.516194:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241571.516270:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241571.516316:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51a50d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782241571.518613:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140101760 00000100:00100000:3.0:1782241571.518624:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140101760 00000100:00100000:3.0:1782241571.518682:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782241571.518692:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140101760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241571.518865:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140101760:12345-0@lo:502:mount.lustre.0 Request processed in 174us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241571.518873:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782241571.520924:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782241571.521162:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1782241571.521203:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1782241571.521242:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101888:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241571.521309:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241571.521362:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51a50d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782241571.522021:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140101888 00000100:00100000:3.0:1782241571.522029:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140101888 00000100:00100000:3.0:1782241571.522078:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241571.522087:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140101888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241571.522208:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140101888:12345-0@lo:502:mount.lustre.0 Request processed in 122us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241571.522216:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241571.522265:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140101888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241571.522317:0:23344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1782241571.522338:0:23344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1782241571.529050:0:23363:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1782241571.529067:0:23363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff890e503f0000) 00000020:00000080:1.0:1782241571.529090:0:23363:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1782241571.533044:0:23363:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890d46921800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1782241571.533054:0:23363:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890d46921800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1782241571.533057:0:23363:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890d46921800 3 00010000:00080000:1.0:1782241571.533098:0:23363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e8140e800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241571.539387:0:23363:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1782241571.539844:0:23363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1782241571.539890:0:23363:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782241571.539904:0:23363:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc9959f2fb1e1b2df 00000100:00080000:1.0:1782241571.539917:0:23363:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241571.539924:0:23363:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff890e8140e800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241571.539963:0:23363:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48039f80 x1868815140102016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241571.539994:0:23363:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782241571.541848:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241571.541855:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241571.541859:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241571.541862:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1782241571.542281:0:23363:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1782241571.542910:0:23344:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1782241571.542950:0:23344:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:0.0:1782241571.542970:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815140102016:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1782241571.542985:0:23344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4499a800/0xc9959f2fb1e1b2ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2d1 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241571.542998:0:23344:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4499a800/0xc9959f2fb1e1b2ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2d1 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241571.543044:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1782241571.543176:0:23344:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782241571.543180:0:23344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782241571.543182:0:23344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241571.543183:0:23344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241571.543184:0:23344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241571.543185:0:23344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241571.543187:0:23344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782241571.543188:0:23344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241571.543190:0:23344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782241571.543193:0:23344:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1782241571.543196:0:23344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782241571.543197:0:23344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782241571.543198:0:23344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241571.543199:0:23344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241571.543303:0:23344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241571.543307:0:23344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241571.543308:0:23344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782241571.543309:0:23344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241571.543310:0:23344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782241571.543348:0:23344:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1782241571.543361:0:23344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140102144:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782241571.543397:0:23344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241571.543427:0:23344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51a50b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241571.543838:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140102144 00000100:00100000:2.0:1782241571.543845:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140102144 00000100:00100000:2.0:1782241571.543892:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782241571.543899:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140102144:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782241571.543926:0:22605:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1782241571.543940:0:22605:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1782241571.545392:0:22592:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1782241571.545423:0:22605:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782241571.545430:0:22605:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1782241571.545667:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:23344:x1868815140102144:12345-0@lo:253:mount.lustre.0 Request processed in 1764us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241571.545680:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782241571.545982:0:23344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:23344:1868815140102144:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782241571.545998:0:23344:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1782241571.546001:0:23344:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782241571.546003:0:23344:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782241571.546005:0:23344:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241571.546006:0:23344:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241571.546008:0:23344:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241571.546025:0:23344:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241571.546027:0:23344:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782241571.546029:0:23344:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241571.546031:0:23344:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782241571.546054:0:23344:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1782241571.549146:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140102016 00000100:00100000:1.0:1782241571.549157:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140102016 00000100:00100000:1.0:1782241571.549205:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241571.549213:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1868815140102016:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782241571.549240:0:22613:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:1.0:1782241571.549272:0:22613:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc9959f2fb1e1b2e6 00000004:00100000:1.0:1782241571.549288:0:22613:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782241571.549335:0:22613:0:(import.c:65:import_set_state_nolock()) ffff890e8140d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241571.549426:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1868815140102016:12345-0@lo:38:llog_process_th.0 Request processed in 212us (6381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241571.549434:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782241571.549672:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff890d48039f80 x1868815140102016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241571.549683:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782241571.549692:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1782241571.549700:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782241571.549712:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782241571.549714:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e8140e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782241571.549721:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815140102016:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1782241571.550636:0:22627:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782241571.550644:0:22627:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782241571.550665:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.550679:0:22627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4499b200/0xc9959f2fb1e1b1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b1ea expref: 17 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.550686:0:22627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b2b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b2ae expref: 17 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.550694:0:22627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.550726:0:22627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b2ae expref: 17 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.550739:0:22627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b2b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2ae expref: 17 pid: 22606 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241571.550751:0:22627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140102272:0@lo:104: 00000100:00100000:0.0:1782241571.551012:0:22627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241571.551062:0:22627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4499b200/0xc9959f2fb1e1b1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ea expref: 17 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.551071:0:22627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e4499b200/0xc9959f2fb1e1b1f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ea expref: 17 pid: 22604 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241571.551081:0:22627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140102400:0@lo:104: 00000100:00100000:0.0:1782241571.551103:0:22627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241571.551127:0:22596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140102272 00000100:00100000:0.0:1782241571.551129:0:22627:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aad80 going to sleep for 11 seconds 00000100:00100000:2.0:1782241571.551134:0:22596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140102272 00000100:00100000:2.0:1782241571.551165:0:22596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140102400 00000100:00100000:2.0:1782241571.551168:0:22596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140102400 00000100:00100000:2.0:1782241571.551182:0:22596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241571.551189:0:22596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+4:22627:x1868815140102272:12345-0@lo:104: 00010000:00010000:2.0:1782241571.551557:0:22596:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241571.551629:0:22596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782241571.551636:0:22596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+4:22627:x1868815140102272:12345-0@lo:104: Request processed in 447us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241571.551645:0:22596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241571.551665:0:22627:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140102272:0@lo:104: 00000100:00100000:2.0:1782241571.551669:0:22596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241571.551680:0:22596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:22627:x1868815140102400:12345-0@lo:104: 00010000:00010000:2.0:1782241571.551703:0:22596:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241571.551747:0:22596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782241571.551753:0:22596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:22627:x1868815140102400:12345-0@lo:104: Request processed in 75us (650us total) trans 0 rc 0/0 00010000:00010000:0.0:1782241571.551753:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782241571.551778:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241571.551786:0:22596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1782241571.551794:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc12aac20) 00000100:00100000:1.0:1782241571.551795:0:22627:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140102400:0@lo:104: 10000000:00010000:0.0:1782241571.551799:0:22600:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241571.551806:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241571.551810:0:22600:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.551817:0:22627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241571.551819:0:22600:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241571.551826:0:22600:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782241571.551858:0:22600:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.551865:0:22600:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241571.551884:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.551900:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1b2ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b2b5 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.551911:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241571.551913:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241571.551915:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241571.551925:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140102528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241571.551952:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241571.551987:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140102528 00000100:00100000:1.0:1782241571.551991:0:22597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140102528 00010000:00010000:1.0:1782241571.552008:0:22597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b2b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2ae expref: 18 pid: 22606 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241571.552027:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241571.552033:0:22597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:3637:x1868815140102528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241571.552042:0:22597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241571.552046:0:22597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b2b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2ae expref: 18 pid: 22606 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.552055:0:22597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2ae expref: 18 pid: 22606 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.552069:0:22597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b2b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2ae expref: 18 pid: 22606 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.552080:0:22597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241571.552107:0:22597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:3637:x1868815140102528:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241571.552113:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241571.552137:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140102528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241571.553186:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241571.553196:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.553205:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241571.553209:0:22601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.553216:0:22601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241571.553220:0:22601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241571.553224:0:22601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241571.553246:0:22601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.553252:0:22601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241571.553277:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.553285:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e43fad600/0xc9959f2fb1e1b1ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b1f1 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.553297:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241571.553306:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241571.553308:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241571.553333:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782241571.553345:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140102656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241571.553386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241571.553418:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140102656 00000100:00100000:1.0:1782241571.553423:0:22599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140102656 00010000:00010000:1.0:1782241571.553439:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4499b200/0xc9959f2fb1e1b1f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ea expref: 17 pid: 22604 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241571.553455:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241571.553459:0:22599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:3637:x1868815140102656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241571.553466:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241571.553469:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4499b200/0xc9959f2fb1e1b1f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ea expref: 17 pid: 22604 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.553475:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4499b200/0xc9959f2fb1e1b1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ea expref: 17 pid: 22604 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.553482:0:22599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4499b200/0xc9959f2fb1e1b1f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1ea expref: 17 pid: 22604 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.553493:0:22599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241571.554444:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241571.554448:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241571.554486:0:22599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782241571.555073:0:22599:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011186535s 00010000:00010000:1.0:1782241571.555081:0:22599:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.555103:0:22599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.555110:0:22599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.555117:0:22599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.555123:0:22599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241571.555128:0:22599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.555136:0:22599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.555153:0:22599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.555164:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241571.555221:0:22599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23eacdb9-0e56-4c3a-b421-5efac43515c0+16:3637:x1868815140102656:12345-0@lo:103:ldlm_bl.0 Request processed in 1758us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241571.555230:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1782241571.555260:0:22627:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.555268:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241571.555274:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4499b600/0xc9959f2fb1e1b2ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241571.555330:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140102656:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1782241571.556589:0:23344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1782241571.557809:0:23370:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1782241571.557815:0:23370:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1782241571.558843:0:23371:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1782241571.559008:0:23344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1782241571.559545:0:23371:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241571.559720:0:23372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23372:1868815140102784:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782241571.559812:0:23372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241571.559846:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140102784 00000100:00100000:0.0:1782241571.559851:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140102784 00000100:00100000:0.0:1782241571.559888:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241571.559895:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23372:x1868815140102784:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782241571.559961:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23372:x1868815140102784:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 65us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241571.559968:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241571.559993:0:23372:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa600 going to sleep for 11 seconds 00000100:00100000:0.0:1782241571.560015:0:23372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23372:1868815140102784:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1782241571.560039:0:23372:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1782241571.560060:0:23372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23372:1868815140102912:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782241571.560086:0:23372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241571.560102:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140102912 00000100:00100000:0.0:1782241571.560105:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140102912 00000100:00100000:0.0:1782241571.560121:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241571.560134:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23372:x1868815140102912:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782241571.560209:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23372:x1868815140102912:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 76us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241571.560215:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241571.560229:0:23372:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa600 going to sleep for 11 seconds 00000100:00100000:0.0:1782241571.560240:0:23372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23372:1868815140102912:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782241571.560278:0:23372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23372:1868815140103040:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1782241571.560300:0:23372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241571.560315:0:23372:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aae40 going to sleep for 11 seconds 00000040:01000000:1.0:1782241571.560507:0:23344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1782241571.560546:0:23344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782241571.560834:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140103040 00000100:00100000:2.0:1782241571.560845:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140103040 00000100:00100000:2.0:1782241571.560883:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241571.560890:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23372:x1868815140103040:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1782241571.560935:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23372:x1868815140103040:12345-0@lo:900:lod0001_rec0000.0 Request processed in 45us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241571.560941:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782241571.561375:0:23372:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff890e778de680 x1868815140103040/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782241587 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241571.561387:0:23372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23372:1868815140103040:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1782241571.561433:0:23372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23372:1868815140103168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782241571.561461:0:23372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241571.561489:0:23372:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa600 going to sleep for 11 seconds 00000100:00100000:2.0:1782241571.561605:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140103168 00000100:00100000:2.0:1782241571.561609:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140103168 00000100:00100000:2.0:1782241571.561641:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782241571.561649:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23372:x1868815140103168:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1782241571.561712:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23372:x1868815140103168:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 63us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241571.561718:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241571.561804:0:23372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23372:1868815140103168:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1782241571.561846:0:23372:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1782241571.563396:0:23344:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1782241571.563413:0:23344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1782241571.563497:0:23344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241571.564243:0:23371:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1782241571.564463:0:23371:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1782241571.566583:0:23344:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1782241571.568399:0:23344:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1782241571.568458:0:23344:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1782241571.568589:0:23344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1782241571.569129:0:23344:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:0.0:1782241571.571219:0:23372:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782241571.571387:0:23372:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1782241571.571391:0:23372:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1782241571.572334:0:23344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1782241571.573570:0:23344:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1782241571.573597:0:23344:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa60ac15ef988 00100000:10000000:1.0:1782241571.573605:0:23344:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1782241571.574427:0:23344:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782241571.574458:0:23344:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782241571.574474:0:23344:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1782241571.574494:0:23344:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1782241571.578922:0:23344:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782241571.579158:0:23344:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782241571.589074:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241572.109049:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00000040:00080000:3.0:1782241572.555780:0:23364:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782241572.613846:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241573.125400:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 10000000:01000000:1.0:1782241573.189868:0:22609:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782241573.189875:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d46921800 from 12 10000000:01000000:1.0:1782241573.189881:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782241573.189926:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241573.189938:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241573.189949:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241573.189984:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140103296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782241573.190178:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241573.190219:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140103296 00000100:00100000:1.0:1782241573.190222:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42b1c000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241573.190227:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140103296 00000100:00100000:3.0:1782241573.190343:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782241573.190356:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+16:22609:x1868815140103296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241573.190371:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241573.190386:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1b2fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b2f4 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241573.190420:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1b2fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b2f4 expref: 17 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241573.190432:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1b2fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b2f4 expref: 17 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241573.190441:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c400, rc 0) 00000100:00100000:3.0:1782241573.190488:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:22609:x1868815140103296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241573.190495:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782241573.190589:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140103296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241573.190606:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241573.190615:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241573.190737:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140103424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782241573.190796:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241573.190821:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42b1c000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241573.190831:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140103424 00000100:00100000:3.0:1782241573.190837:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140103424 00000100:00100000:3.0:1782241573.190869:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782241573.190877:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:22609:x1868815140103424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1782241573.190892:0:22605:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782241573.190913:0:22605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782241573.190917:0:22605:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1782241573.191024:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:22609:x1868815140103424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241573.191032:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782241573.191043:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140103424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782241573.191093:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782241573.191101:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241573.191115:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241573.191125:0:22609:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782241573.191128:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d46713800 from 12 10000000:01000000:0.0:1782241573.191131:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782241573.191164:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241573.191172:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241573.191180:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241573.191193:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140103552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782241573.191221:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241573.191244:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa900 going to sleep for 11 seconds 00000100:00100000:3.0:1782241573.191285:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140103552 00000100:00100000:3.0:1782241573.191307:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140103552 00000100:00100000:3.0:1782241573.191339:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782241573.191346:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:22609:x1868815140103552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241573.191353:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241573.191360:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1b309 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b302 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241573.191374:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1b309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b302 expref: 18 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241573.191382:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1b309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b302 expref: 18 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241573.191389:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c600, rc 0) 00000100:00100000:3.0:1782241573.191456:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:22609:x1868815140103552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241573.191461:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782241573.191609:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140103552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241573.191618:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241573.191624:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241573.191662:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140103680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782241573.191684:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241573.191708:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa900 going to sleep for 11 seconds 00000100:00100000:3.0:1782241573.191724:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140103680 00000100:00100000:3.0:1782241573.191729:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140103680 00000100:00100000:3.0:1782241573.191864:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782241573.191873:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:22609:x1868815140103680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1782241573.191884:0:22605:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782241573.191896:0:22605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782241573.191901:0:22605:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1782241573.192092:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:22609:x1868815140103680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 219us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241573.192096:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140103680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782241573.192099:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 10000000:01000000:1.0:1782241573.192133:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782241573.192138:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241573.192149:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782241573.580571:0:23364:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782241573.641271:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241574.153799:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00010000:00010000:0.0:1782241574.665441:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241575.176929:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00010000:00010000:2.0:1782241575.685298:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782241575.776571:0:23615:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1782241576.197170:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 0 seconds 00000020:00000004:1.0:1782241576.564198:0:23667:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782241576.564719:0:23667:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1782241576.711923:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1782241576.711930:0:22059:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1782241576.711934:0:22059:0:(import.c:65:import_set_state_nolock()) ffff890e7c699800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241576.711946:0:22059:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff890e7c699800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241576.711968:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140103808:0@lo:400:kworker.0 00000100:00100000:2.0:1782241576.711969:0:22059:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f686a00 x1868815140103936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241576.711983:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241576.711987:0:22059:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241576.711995:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241576.711997:0:22059:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241576.712021:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241576.712023:0:22059:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241576.712026:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241576.712028:0:22059:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782241576.712033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241576.712074:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140104320:0@lo:400:kworker.0 00000100:00100000:0.0:1782241576.712089:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241576.712095:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140104064:0@lo:400:kworker.0 00000100:00100000:2.0:1782241576.712108:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241576.712125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241576.712129:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241576.712134:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140104192:0@lo:400:kworker.0 00000100:00100000:2.0:1782241576.712161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241576.712195:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241576.712213:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140104320 00000100:00100000:2.0:1782241576.712234:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140104320 00000100:00100000:2.0:1782241576.712270:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140104064 00000100:00100000:2.0:1782241576.712273:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140104064 00000100:00100000:2.0:1782241576.712285:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241576.712293:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140104320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241576.712338:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140104192 00000100:00100000:0.0:1782241576.712342:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140104192 00000100:00100000:2.0:1782241576.712345:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140104320:12345-0@lo:400:kworker.0 Request processed in 52us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241576.712352:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241576.712368:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241576.712368:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782241576.712374:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140104064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241576.712374:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140104192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241576.712403:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140104064:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241576.712413:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140104192:12345-0@lo:400:kworker.0 Request processed in 39us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241576.712416:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241576.712418:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782241576.712449:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140104192:0@lo:400:kworker.0 00010000:00080000:2.0:1782241576.712462:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e7f686d80 x1868815140104320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241576.712471:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140104320:0@lo:400:kworker.0 00010000:00080000:2.0:1782241576.712504:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e7f685880 x1868815140104064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241576.712512:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140104064:0@lo:400:kworker.0 00000100:00100000:1.0:1782241576.712569:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140103936:0@lo:38:kworker.0 00000100:00100000:1.0:1782241576.712599:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241576.712647:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140103808 00000100:00100000:1.0:1782241576.712651:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140103808 00000100:00100000:1.0:1782241576.712684:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782241576.712691:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4790bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:3639:x1868815140103808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241576.712713:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140103936 00000100:00100000:0.0:1782241576.712716:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140103936 00000100:00100000:1.0:1782241576.712727:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4790bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:3639:x1868815140103808:12345-0@lo:400:kworker.0 Request processed in 36us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241576.712733:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782241576.712733:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782241576.712737:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1868815140103936:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1782241576.712778:0:22617:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 639 last 0 00000020:00000080:0.0:1782241576.712809:0:22617:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1b310 00000100:00100000:1.0:1782241576.712812:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140103808:0@lo:400:kworker.0 00000004:00100000:0.0:1782241576.712823:0:22617:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1782241576.712829:0:22617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1782241576.716952:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140104448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241576.717013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241576.717056:0:22616:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1782241576.717070:0:22616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1782241576.717189:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140104448 00000100:00100000:0.0:1782241576.717195:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140104448 00000100:00100000:0.0:1782241576.717367:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782241576.717376:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140104448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241576.717405:0:23684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1782241576.717449:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140104448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241576.717456:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782241576.717495:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140104448:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1782241576.723163:0:22617:0:(import.c:65:import_set_state_nolock()) ffff890e4548d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241576.723271:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1868815140103936:12345-0@lo:38:kworker.0 Request processed in 10527us (10665us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241576.723282:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1782241576.723361:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1782241576.723371:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1782241576.723376:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1782241576.723379:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7c699800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1782241576.723398:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000db3652ed): req@ffff890d48039880 x1868815140097024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241576.723422:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140103936:0@lo:38:kworker.0 00000100:00100000:0.0:1782241576.723516:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241576.723531:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140104576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241576.723569:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241576.723613:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140104576 00000100:00100000:0.0:1782241576.723618:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140104576 00000100:00100000:0.0:1782241576.723649:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782241576.723656:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140104576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241576.723681:0:22616:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782241576.723716:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140104576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241576.723723:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782241576.723834:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140104576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241576.723939:0:22653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241576.723953:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982540 going to sleep for 11 seconds 00000100:00100000:2.0:1782241576.723964:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140097024 00000100:00100000:2.0:1782241576.723967:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140097024 00000100:00100000:2.0:1782241576.723986:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782241576.723991:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22653:x1868815140097024:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782241576.724039:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22653:x1868815140097024:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 48us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241576.724046:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782241576.724069:0:22653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22653:1868815140097024:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1782241576.724098:0:22653:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1782241576.724125:0:22653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22653:1868815140104704:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782241576.724158:0:22653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241576.724176:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e412ed6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241576.724186:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140104704 00000100:00100000:2.0:1782241576.724189:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140104704 00000100:00100000:2.0:1782241576.724206:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782241576.724211:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22653:x1868815140104704:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782241576.724306:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22653:x1868815140104704:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241576.724312:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782241576.724332:0:22653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22653:1868815140104704:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782241576.724410:0:22653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22653:1868815140104832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782241576.724437:0:22653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241576.724451:0:22653:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e412edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241576.724462:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140104832 00000100:00100000:2.0:1782241576.724465:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140104832 00000100:00100000:2.0:1782241576.724482:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241576.724487:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22653:x1868815140104832:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782241576.724525:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22653:x1868815140104832:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 38us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241576.724531:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241576.724554:0:22653:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22653:1868815140104832:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1782241576.724587:0:22653:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241576.727033:0:22653:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782241576.727109:0:22653:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1782241576.727114:0:22653:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1782241577.210233:0:23718:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782241577.210437:0:23718:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782241577.733644:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782241578.500680:0:23766:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd904bac30 20000000:00000080:0.0:1782241578.500696:0:23766:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890e46e3ec00 uarg=0000000000000000 20000000:01000000:0.0:1782241578.500735:0:23766:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1782241578.500742:0:23766:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1782241578.500751:0:23766:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1782241578.502011:0:23767:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1782241578.502143:0:23766:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782241578.512331:0:23766:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782241578.512708:0:23766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241578.512725:0:23766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b1c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b1b9 expref: 17 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241578.512731:0:23766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b2c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b2bc expref: 17 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241578.512737:0:23766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241578.512796:0:23766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b2bc expref: 17 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241578.512811:0:23766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b2c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2bc expref: 17 pid: 22606 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241578.512825:0:23766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23766:1868815140104960:0@lo:104: 00000100:00100000:0.0:1782241578.512886:0:23766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241578.512948:0:23766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b1b9 expref: 17 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241578.512957:0:23766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b1c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1b9 expref: 17 pid: 22604 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241578.512965:0:23766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23766:1868815140105088:0@lo:104: 00000100:00100000:0.0:1782241578.512988:0:23766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241578.513013:0:23766:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa600 going to sleep for 11 seconds 00000100:00100000:1.0:1782241578.513073:0:22595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140104960 00000100:00100000:1.0:1782241578.513081:0:22595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140104960 00000100:00100000:1.0:1782241578.513117:0:22595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140105088 00000100:00100000:1.0:1782241578.513120:0:22595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140105088 00000100:00100000:1.0:1782241578.513140:0:22595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241578.513149:0:22595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+4:23766:x1868815140104960:12345-0@lo:104: 00010000:00010000:1.0:1782241578.513161:0:22595:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241578.513245:0:22595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782241578.513252:0:22595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+4:23766:x1868815140104960:12345-0@lo:104: Request processed in 104us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241578.513259:0:22595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241578.513275:0:22595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241578.513281:0:22595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:23766:x1868815140105088:12345-0@lo:104: 00010000:00010000:1.0:1782241578.513289:0:22595:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241578.513330:0:22595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782241578.513335:0:22595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:23766:x1868815140105088:12345-0@lo:104: Request processed in 55us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241578.513342:0:22595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782241578.513515:0:23766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23766:1868815140104960:0@lo:104: 00000100:00100000:0.0:1782241578.513523:0:23766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23766:1868815140105088:0@lo:104: 00010000:00010000:0.0:1782241578.513543:0:23766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.513973:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782241578.513986:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.513994:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ae00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241578.513998:0:23368:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514007:0:23368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241578.514015:0:23368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241578.514021:0:23368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782241578.514146:0:23368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514153:0:23368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241578.514181:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514199:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4499ae00/0xc9959f2fb1e1b2bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b2c3 expref: -99 pid: 23344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514212:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241578.514216:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514222:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499aa00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241578.514225:0:23368:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514243:0:23368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241578.514250:0:23368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241578.514256:0:23368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782241578.514260:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241578.514294:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140105216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241578.514330:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241578.514541:0:23368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514548:0:23368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782241578.514582:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1782241578.514600:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514608:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b1b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b1c0 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514621:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241578.514623:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241578.514624:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241578.514644:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140105216 00000100:00100000:2.0:1782241578.514648:0:22597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140105216 00010000:00010000:2.0:1782241578.514669:0:22597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b2c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2bc expref: 18 pid: 22606 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241578.514706:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241578.514713:0:22597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:3637:x1868815140105216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241578.514724:0:22597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241578.514729:0:22597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b2c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2bc expref: 18 pid: 22606 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514747:0:22597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2bc expref: 18 pid: 22606 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514783:0:22597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b2c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2bc expref: 18 pid: 22606 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.514796:0:22597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241578.515071:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140105344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241578.515098:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241578.515170:0:22598:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782241578.515179:0:22598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1782241578.515331:0:22597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:3637:x1868815140105216:12345-0@lo:103:ldlm_bl.0 Request processed in 617us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241578.515338:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241578.515353:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140105344 00000100:00100000:2.0:1782241578.515356:0:22597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140105344 00010000:00010000:2.0:1782241578.515382:0:22597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b1c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1b9 expref: 17 pid: 22604 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241578.515406:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782241578.515412:0:22597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:3637:x1868815140105344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241578.515420:0:22597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241578.515424:0:22597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b1c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1b9 expref: 17 pid: 22604 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515432:0:22597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1b9 expref: 17 pid: 22604 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515441:0:22597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b1c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b1b9 expref: 17 pid: 22604 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515451:0:22597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515468:0:22597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515481:0:22597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515488:0:22597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515494:0:22597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515500:0:22597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515505:0:22597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499a200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241578.515509:0:22597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515516:0:22597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515530:0:22597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241578.515540:0:22597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241578.515563:0:22597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+16:3637:x1868815140105344:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241578.515570:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782241578.515850:0:23766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241578.515945:0:23766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241578.515952:0:23766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b317 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241578.517240:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140105216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241578.517263:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140105344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241578.761040:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782241579.206918:0:22647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1782241579.783363:0:22609:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782241579.783384:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d46921800 from 13 10000000:01000000:2.0:1782241579.783389:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782241579.783547:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241579.783559:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241579.783570:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241579.783596:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140105472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241579.783663:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241579.783699:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42b1c6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782241579.783745:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241579.786463:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140105472 00000100:00100000:3.0:1782241579.786478:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140105472 00000100:00100000:3.0:1782241579.786547:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782241579.786557:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+16:22609:x1868815140105472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241579.786574:0:22605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241579.786592:0:22605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1b325 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b31e expref: -99 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241579.786617:0:22605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1b325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b31e expref: 17 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241579.786628:0:22605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1b325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b31e expref: 17 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241579.786647:0:22605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164de00, rc 0) 00000100:00100000:3.0:1782241579.786711:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:22609:x1868815140105472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241579.786718:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782241579.786787:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140105472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241579.786805:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241579.786814:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241579.786881:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140105600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241579.786910:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241579.786926:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241579.786939:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140105600 00000100:00100000:3.0:1782241579.786942:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140105600 00000100:00100000:3.0:1782241579.786959:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782241579.786964:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4790b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:22609:x1868815140105600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241579.787058:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4790b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:22609:x1868815140105600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241579.787064:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782241579.787086:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140105600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241579.787109:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140105728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241579.787140:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241579.787156:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241579.787177:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140105728 00000100:00100000:3.0:1782241579.787180:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140105728 00000100:00100000:3.0:1782241579.787210:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782241579.787216:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4790a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:22609:x1868815140105728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241579.787279:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4790a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:22609:x1868815140105728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241579.787285:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782241579.787315:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140105728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782241579.799320:0:23813:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1782241579.800713:0:22609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1782241579.800742:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782241579.800776:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241579.800788:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241579.800798:0:22609:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782241579.800801:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d46713800 from 13 10000000:01000000:1.0:1782241579.800803:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782241579.800839:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241579.800847:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241579.800868:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241579.800895:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140105856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782241579.800958:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241579.800995:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e49e72000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241579.802301:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140105856 00000100:00100000:3.0:1782241579.802311:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140105856 00000100:00100000:3.0:1782241579.802372:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782241579.802383:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4790b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+17:22609:x1868815140105856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241579.802402:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241579.802417:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1b333 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b32c expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241579.802560:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1b333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b32c expref: 18 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241579.802571:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1b333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b32c expref: 18 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241579.802580:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164cc00, rc 0) 00000100:00100000:3.0:1782241579.802637:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4790b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:22609:x1868815140105856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 256us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241579.802643:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782241579.802698:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140105856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241579.802723:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241579.802732:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241579.802815:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140105984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241579.802844:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241579.802862:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56840 going to sleep for 11 seconds 00000100:00100000:3.0:1782241579.802876:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140105984 00000100:00100000:3.0:1782241579.802879:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140105984 00000100:00100000:3.0:1782241579.802901:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782241579.802906:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4790ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:22609:x1868815140105984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241579.803004:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4790ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:22609:x1868815140105984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241579.803011:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782241579.803038:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140105984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241579.803064:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140106112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241579.803095:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241579.803106:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56840 going to sleep for 11 seconds 00000100:00100000:3.0:1782241579.803117:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140106112 00000100:00100000:3.0:1782241579.803120:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140106112 00000100:00100000:3.0:1782241579.803138:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782241579.803144:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:22609:x1868815140106112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241579.804648:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:22609:x1868815140106112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1497us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241579.804666:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782241579.805367:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140106112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782241579.806966:0:23818:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782241579.811633:0:22609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782241579.811678:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782241579.811691:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241579.811704:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241580.813517:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241581.838550:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241571/real 1782241571] req@ffff890e7f684a80 x1868815140100224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241581 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241581.838585:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e7f684a80 x1868815140100224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241581 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241581.838596:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241571/real 1782241571] req@ffff890d48039c00 x1868815140099968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241581 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241581.838625:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890d48039c00 x1868815140099968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241581 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782241581.838643:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241581.838671:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782241581.838674:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140100224:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1782241581.838681:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e436dd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241581.838686:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782241581.838689:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140099968:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1782241581.838847:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241581.838851:0:22059:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241581.838854:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241581.838857:0:22059:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241581.838877:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241581.838880:0:22059:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782241581.838883:0:22059:0:(import.c:65:import_set_state_nolock()) ffff890e436dd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241581.838887:0:22059:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 634 00000100:00080000:2.0:1782241581.838892:0:22059:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782241581.838898:0:22059:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff890e436dd800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241581.838917:0:22059:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f686300 x1868815140106752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241581.838940:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241581.838943:0:22059:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782241581.838945:0:22059:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241581.838948:0:22059:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 634 00000100:00080000:2.0:1782241581.838951:0:22059:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782241581.838954:0:22059:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890e449fb000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241581.838966:0:22059:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f686d80 x1868815140106880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782241581.838996:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140106368:0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241581.839097:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782241581.839103:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23eacdb9-0e56-4c3a-b421-5efac43515c0:3640:1868815140106240:0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241581.839164:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140107008:0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241581.839212:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140106624:0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241581.839250:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241581.839255:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815140106496:0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241581.839303:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140106368 00000100:00100000:2.0:1782241581.839309:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140106368 00000100:00100000:2.0:1782241581.839362:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140106624 00000100:00100000:2.0:1782241581.839366:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140106624 00000100:00100000:2.0:1782241581.839385:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241581.839401:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815140106368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839450:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815140106368:12345-0@lo:400:kworker.0 Request processed in 51us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241581.839458:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241581.839475:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782241581.839481:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140106624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839510:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140106624:12345-0@lo:400:kworker.0 Request processed in 30us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241581.839516:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782241581.839534:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140106240 00000100:00100000:2.0:1782241581.839538:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140106240 00000100:00100000:2.0:1782241581.839563:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782241581.839569:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:3640:x1868815140106240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839597:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:3640:x1868815140106240:12345-0@lo:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241581.839603:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782241581.839629:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140107008 00000100:00100000:2.0:1782241581.839632:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140107008 00000100:00100000:2.0:1782241581.839654:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140106496 00000100:00100000:2.0:1782241581.839657:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140106496 00000100:00100000:2.0:1782241581.839669:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782241581.839676:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140107008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839704:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140107008:12345-0@lo:400:kworker.0 Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241581.839710:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782241581.839721:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241581.839727:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815140106496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839786:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815140106496:12345-0@lo:400:kworker.0 Request processed in 58us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241581.839792:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241581.839827:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23eacdb9-0e56-4c3a-b421-5efac43515c0:3640:1868815140106240:0@lo:400:kworker.0 00010000:00080000:2.0:1782241581.839838:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e7f686a00 x1868815140107008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241581.839849:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140107008:0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839859:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140106368:0@lo:400:kworker.0 00010000:00080000:2.0:1782241581.839887:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e7f684a80 x1868815140106496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241581.839895:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815140106496:0@lo:400:kworker.0 00000100:00100000:2.0:1782241581.839905:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140106624:0@lo:400:kworker.0 00010000:00010000:0.0:1782241581.840512:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241581.840561:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241581.840571:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140107136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241581.840603:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241581.840629:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140106752:0@lo:8:kworker.0 00000400:00000100:0.0:1782241581.840647:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140106752 offset 0 length 520: 4 00000100:00100000:0.0:1782241581.840661:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140106880:0@lo:8:kworker.0 00000400:00000100:0.0:1782241581.840676:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140106880 offset 0 length 520: 4 00000100:00100000:2.0:1782241581.847061:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140107136 00000100:00100000:2.0:1782241581.847071:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140107136 00000100:00100000:2.0:1782241581.847132:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782241581.847142:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140107136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782241581.847189:0:22616:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782241581.847280:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140107136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (6675us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241581.847287:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782241581.847323:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140107264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241581.847372:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241581.847409:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140107264 00000100:00100000:2.0:1782241581.847424:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140107264 00000100:00100000:2.0:1782241581.847448:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782241581.847454:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140107264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782241581.847470:0:22617:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782241581.847503:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140107264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241581.847522:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782241581.847573:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140107264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241581.847609:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140107136:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782241582.857012:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782241582.858187:0:23345:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1782241583.814826:0:23364:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782241583.877744:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241583.880180:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241568/real 1782241568] req@ffff890e778df100 x1868815140098048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241583 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241583.880213:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e778df100 x1868815140098048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241583 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241583.880836:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241568/real 1782241568] req@ffff890e778df480 x1868815140098176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241583 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241583.880854:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e778df480 x1868815140098176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241583 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782241583.880874:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d47b7a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241583.880898:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782241583.880902:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140098048:0@lo:8:kworker.0 00000100:00080000:3.0:1782241583.880908:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48885000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241583.880913:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782241583.880916:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140098176:0@lo:8:kworker.0 00000100:00100000:1.0:1782241583.881139:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1782241583.881178:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241583.881182:0:22059:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782241583.881184:0:22059:0:(import.c:65:import_set_state_nolock()) ffff890d47b7a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241583.881189:0:22059:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:2.0:1782241583.881194:0:22059:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782241583.881200:0:22059:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff890d47b7a800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241583.881218:0:22059:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f686a00 x1868815140107648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241583.881231:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241583.881233:0:22059:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782241583.881242:0:22059:0:(import.c:65:import_set_state_nolock()) ffff890d48885000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241583.881245:0:22059:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:2.0:1782241583.881248:0:22059:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782241583.881251:0:22059:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff890d48885000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241583.881263:0:22059:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f684380 x1868815140107776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241583.881311:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782241583.881323:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140108032:0@lo:400:kworker.0 00000100:00100000:3.0:1782241583.881384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241583.881426:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140108032 00000100:00100000:3.0:1782241583.881433:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140108032 00000100:00100000:3.0:1782241583.881480:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782241583.881489:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140108032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241583.881540:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140108032:12345-0@lo:400:kworker.0 Request processed in 52us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241583.881546:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782241583.881585:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140108032:0@lo:400:kworker.0 00000100:00100000:3.0:1782241583.886215:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140107904:0@lo:400:kworker.0 00000100:00100000:3.0:1782241583.886292:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241583.886337:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241583.886344:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140107520:0@lo:400:kworker.0 00000100:00100000:3.0:1782241583.886371:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241583.886416:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140107904 00000100:00100000:3.0:1782241583.886424:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140107904 00000100:00100000:3.0:1782241583.886473:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782241583.886482:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140107904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241583.886534:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140107904:12345-0@lo:400:kworker.0 Request processed in 53us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241583.886542:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782241583.886562:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140107520 00000100:00100000:3.0:1782241583.886566:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140107520 00000100:00100000:3.0:1782241583.886588:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782241583.886594:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140107520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241583.886624:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140107520:12345-0@lo:400:kworker.0 Request processed in 30us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241583.886630:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782241583.886666:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140107520:0@lo:400:kworker.0 00010000:00080000:3.0:1782241583.886691:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e7f687800 x1868815140107904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241583.886702:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140107904:0@lo:400:kworker.0 00000100:00100000:1.0:1782241583.887736:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140107392:0@lo:400:kworker.0 00000100:00100000:1.0:1782241583.887800:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241583.887845:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140107392 00000100:00100000:1.0:1782241583.887851:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140107392 00000100:00100000:1.0:1782241583.887883:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782241583.887889:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:3637:x1868815140107392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241583.887926:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:3637:x1868815140107392:12345-0@lo:400:kworker.0 Request processed in 37us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241583.887933:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782241583.887973:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140107392:0@lo:400:kworker.0 00000100:00080000:2.0:1782241583.890278:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241583.890287:0:22059:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241583.890290:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241583.890294:0:22059:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782241583.893184:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140107648:0@lo:8:kworker.0 00000400:00000100:3.0:1782241583.893250:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140107648 offset 0 length 520: 4 00000100:00100000:3.0:1782241583.893289:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140107776:0@lo:8:kworker.0 00000400:00000100:3.0:1782241583.893309:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140107776 offset 0 length 520: 4 00000100:00100000:0.0:1782241583.893434:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140108160:0@lo:400:kworker.0 00000100:00100000:0.0:1782241583.893471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241583.893831:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140108160 00000100:00100000:3.0:1782241583.893839:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140108160 00000100:00100000:3.0:1782241583.893894:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782241583.893904:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140108160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241583.893956:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140108160:12345-0@lo:400:kworker.0 Request processed in 53us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241583.893962:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1782241583.894036:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e7d637100 x1868815140108160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241583.894063:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140108160:0@lo:400:kworker.0 00010000:00010000:0.0:1782241584.906576:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241585.928878:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782241586.478929:0:24117:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782241586.478933:0:24117:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1782241586.478935:0:24117:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1782241586.479066:0:24117:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff890e4813b000 00000020:01000004:1.0:1782241586.479084:0:24117:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1782241586.479097:0:24117:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782241586.479111:0:24117:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff890d477019c0) 00000020:00000080:1.0:1782241586.479128:0:24117:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1782241586.603394:0:24117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1782241586.608148:0:24117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1782241586.609382:0:24117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1782241586.609860:0:24117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1782241586.610166:0:24117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1782241586.610462:0:24117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1782241586.610939:0:24117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1782241586.613554:0:24117:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782241586.614271:0:24117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1782241586.614286:0:24117:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782241586.614300:0:24117:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc9959f2fb1e1b341 00000020:01000004:2.0:1782241586.614307:0:24117:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1782241586.614330:0:24117:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782241586.614333:0:24117:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782241586.614339:0:24117:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1782241586.614344:0:24117:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1782241586.614357:0:24117:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff890e81740000) 00000020:00000080:2.0:1782241586.614368:0:24117:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1782241586.624399:0:24117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782241586.624584:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1782241586.624590:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1782241586.630464:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1782241586.630476:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1782241586.631213:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1782241586.631226:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1782241586.638822:0:24117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241586.638996:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1782241586.639002:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1782241586.642049:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1782241586.642066:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1782241586.696615:0:24117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241586.701232:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1782241586.701245:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1782241586.706458:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782241586.706474:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1782241586.713453:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782241586.713468:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1782241586.719450:0:24117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782241586.719694:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1782241586.719701:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1782241586.723142:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1782241586.723167:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1782241586.790300:0:24117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782241586.790488:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782241586.790562:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1782241586.793957:0:24117:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1782241586.793979:0:24117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782241586.794529:0:24117:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782241586.794557:0:24117:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1782241586.794564:0:24117:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1782241586.826807:0:24117:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782241586.827034:0:24117:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.158@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1782241586.827039:0:24117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782241586.827041:0:24117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782241586.827042:0:24117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241586.827043:0:24117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241586.827044:0:24117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241586.827046:0:24117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241586.827047:0:24117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782241586.827049:0:24117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241586.827050:0:24117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782241586.827054:0:24117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1782241586.827056:0:24117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782241586.827057:0:24117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782241586.827058:0:24117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241586.827059:0:24117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241586.827060:0:24117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241586.827061:0:24117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241586.827062:0:24117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782241586.827063:0:24117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241586.827064:0:24117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782241586.827090:0:24117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1782241586.827111:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108288:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782241586.827178:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241586.827284:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140108288 00000100:00100000:0.0:1782241586.827291:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140108288 00000100:00100000:0.0:1782241586.827345:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782241586.827355:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6d39e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:24117:x1868815140108288:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782241586.827384:0:22604:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782241586.827387:0:22604:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1782241586.827391:0:22604:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782241586.828097:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6d39e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:24117:x1868815140108288:12345-0@lo:253:mount.lustre.0 Request processed in 742us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241586.828106:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782241586.828571:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4286b780 going to sleep for 11 seconds 00000100:00100000:1.0:1782241586.828594:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108288:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782241586.828605:0:24117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782241586.828608:0:24117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782241586.828609:0:24117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782241586.828610:0:24117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241586.828611:0:24117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241586.828613:0:24117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241586.828614:0:24117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241586.828615:0:24117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782241586.828617:0:24117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241586.828625:0:24117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782241586.828641:0:24117:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890e4813b000 from lustre-OST0000 10000000:01000000:1.0:1782241586.828679:0:24117:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1782241586.828682:0:24117:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782241586.828689:0:24117:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff890e77d999c0 local copy 00010000:00010000:1.0:1782241586.828698:0:24117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241586.828809:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241586.829539:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241586.829625:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4286b000 going to sleep for 11 seconds 00000100:00100000:0.0:1782241586.833040:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140108416 00000100:00100000:0.0:1782241586.833059:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140108416 00000100:00100000:1.0:1782241586.833179:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782241586.833190:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:24117:x1868815140108416:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241586.833338:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:24117:x1868815140108416:12345-0@lo:501:mount.lustre.0 Request processed in 149us (3798us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782241586.833346:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782241586.833568:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108416:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782241586.833595:0:24117:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782241586.833624:0:24117:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782241586.833633:0:24117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241586.833643:0:24117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241586.833674:0:24117:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890e4813b000 10000000:01000000:3.0:1782241586.833679:0:24117:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782241586.833684:0:24117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782241586.833687:0:24117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782241586.833691:0:24117:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782241586.833694:0:24117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782241586.833721:0:24117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c000/0xc9959f2fb1e1b34f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241586.833729:0:24117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164c000/0xc9959f2fb1e1b34f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241586.833737:0:24117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164c000/0xc9959f2fb1e1b34f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241586.833810:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782241586.833858:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241586.833887:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d300 going to sleep for 11 seconds 00000100:00100000:1.0:1782241586.834269:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140108544 00000100:00100000:1.0:1782241586.834274:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140108544 00000100:00100000:1.0:1782241586.834342:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782241586.834349:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+18:24117:x1868815140108544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241586.834358:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241586.834370:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b356 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b34f expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241586.834402:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b34f expref: 19 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241586.834413:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e7c311c00/0xc9959f2fb1e1b356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b34f expref: 19 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241586.834433:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c311c00, rc 0) 00000100:00100000:1.0:1782241586.834476:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:24117:x1868815140108544:12345-0@lo:101:mount.lustre.0 Request processed in 127us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241586.834482:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782241586.834544:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241586.834556:0:24117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164c000/0xc9959f2fb1e1b34f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b356 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241586.834565:0:24117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164c000/0xc9959f2fb1e1b34f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b356 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782241586.835732:0:24117:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1782241586.836799:0:24117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241586.840091:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1782241586.840546:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1782241586.840565:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1782241586.840707:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1782241586.840723:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1782241586.840735:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1782241586.840845:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1782241586.840864:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1782241586.840877:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1782241586.840891:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1782241586.840905:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1782241586.840918:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1782241586.840944:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1782241586.840951:0:24117:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1782241586.841081:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241586.841164:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241586.841558:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140108672 00000100:00100000:2.0:1782241586.841567:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140108672 00000100:00100000:2.0:1782241586.841635:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782241586.841645:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:24117:x1868815140108672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241586.843107:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:24117:x1868815140108672:12345-0@lo:501:mount.lustre.0 Request processed in 1459us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241586.843118:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782241586.850518:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d600 going to sleep for 11 seconds 00000100:00100000:3.0:1782241586.850559:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241586.850638:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241586.850715:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241586.850753:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d600 going to sleep for 11 seconds 00000100:00100000:1.0:1782241586.850851:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140108800 00000100:00100000:1.0:1782241586.850858:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140108800 00000100:00100000:1.0:1782241586.850915:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782241586.850925:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:24117:x1868815140108800:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241586.853545:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:24117:x1868815140108800:12345-0@lo:503:mount.lustre.0 Request processed in 2613us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241586.853558:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782241586.854135:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782241586.855538:0:24117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782241586.855628:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241586.855691:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241586.855732:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e477d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241586.856106:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140108928 00000100:00100000:0.0:1782241586.856122:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140108928 00000100:00100000:0.0:1782241586.856173:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782241586.856182:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:24117:x1868815140108928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241586.856916:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:24117:x1868815140108928:12345-0@lo:502:mount.lustre.0 Request processed in 732us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241586.856931:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782241586.857673:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140108928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782241586.858118:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1782241586.858157:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1782241586.858178:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1782241586.858194:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1782241586.858280:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1782241586.858295:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1782241586.858307:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1782241586.858319:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1782241586.858332:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1782241586.858361:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1782241586.858375:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1782241586.858386:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1782241586.858418:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241586.858472:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241586.859624:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e477d8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241586.861004:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140109056 00000100:00100000:1.0:1782241586.861014:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140109056 00000100:00100000:1.0:1782241586.861081:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782241586.861091:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:24117:x1868815140109056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241586.861271:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:24117:x1868815140109056:12345-0@lo:502:mount.lustre.0 Request processed in 180us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241586.861279:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782241586.861472:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241586.861552:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1782241586.861567:0:24117:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1782241586.863994:0:24135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782241586.864005:0:24135:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1782241586.864031:0:24135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241586.864035:0:24135:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1782241586.864042:0:24135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241586.864057:0:24135:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff890d47703380) 00000020:00000080:1.0:1782241586.864080:0:24135:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782241586.864085:0:24135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782241586.864321:0:24135:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e4813b000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1782241586.864329:0:24135:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782241586.864336:0:24135:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc9959f2fb1e1b364 00010000:00010000:1.0:1782241586.868701:0:24135:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1782241586.871845:0:24135:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:1.0:1782241586.874476:0:24135:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1782241586.881914:0:24135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1782241586.881926:0:24135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241586.881932:0:24135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241586.881934:0:24135:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1782241586.881938:0:24135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782241586.881940:0:24135:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1782241586.881942:0:24135:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782241586.881943:0:24135:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782241586.882349:0:24135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782241586.882355:0:24135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241586.882357:0:24135:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782241586.882362:0:24135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241586.882366:0:24135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241586.882367:0:24135:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782241586.882370:0:24135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782241586.882372:0:24135:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782241586.882374:0:24135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241586.882377:0:24135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241586.882378:0:24135:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782241586.882380:0:24135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241586.882382:0:24135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241586.882383:0:24135:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782241586.882386:0:24135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1782241586.882419:0:24135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241586.882422:0:24135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241586.882424:0:24135:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782241586.882427:0:24135:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1782241586.886516:0:24117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1782241586.886579:0:24117:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782241586.886603:0:24117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c000/0xc9959f2fb1e1b34f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b356 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241586.886617:0:24117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164c000/0xc9959f2fb1e1b34f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b356 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241586.886626:0:24117:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e4813b000 from 1 10000000:01000000:3.0:1782241586.886629:0:24117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241586.886668:0:24117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241586.886677:0:24117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241586.886688:0:24117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241586.886730:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782241586.886833:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241586.886865:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219df00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241586.887037:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140109184 00000100:00100000:0.0:1782241586.887045:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140109184 00000100:00100000:0.0:1782241586.887099:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782241586.887116:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:24117:x1868815140109184:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241586.887131:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241586.887145:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4499a400/0xc9959f2fb1e1b372 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b36b expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241586.887169:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499a400/0xc9959f2fb1e1b372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b36b expref: 20 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241586.887179:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4499a400/0xc9959f2fb1e1b372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b36b expref: 20 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241586.887188:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a400, rc 0) 00000100:00100000:0.0:1782241586.887240:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:24117:x1868815140109184:12345-0@lo:101:mount.lustre.0 Request processed in 133us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241586.887247:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782241586.888724:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241586.888773:0:24117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241586.888785:0:24117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782241586.899224:0:24117:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1782241586.899564:0:24117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241586.899809:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1782241586.900176:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1782241586.900196:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1782241586.900210:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1782241586.900222:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1782241586.900234:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1782241586.900265:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1782241586.900281:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1782241586.900293:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1782241586.900306:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1782241586.900319:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1782241586.900336:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1782241586.900341:0:24117:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1782241586.900416:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241586.900503:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241586.900542:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d540 going to sleep for 11 seconds 00000100:00100000:2.0:1782241586.901954:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140109312 00000100:00100000:2.0:1782241586.901975:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140109312 00000100:00100000:2.0:1782241586.902037:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782241586.902047:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:24117:x1868815140109312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241586.902210:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:24117:x1868815140109312:12345-0@lo:501:mount.lustre.0 Request processed in 163us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241586.902218:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782241586.902461:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241586.902501:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241586.902544:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241586.902590:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d540 going to sleep for 11 seconds 00000100:00100000:0.0:1782241586.902641:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140109440 00000100:00100000:0.0:1782241586.902646:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140109440 00000100:00100000:0.0:1782241586.902686:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782241586.902692:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:24117:x1868815140109440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241586.902809:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:24117:x1868815140109440:12345-0@lo:503:mount.lustre.0 Request processed in 116us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241586.902815:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782241586.903549:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109440:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782241586.904327:0:24117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241586.904416:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241586.904468:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241586.904500:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4b10d780 going to sleep for 11 seconds 00000100:00100000:2.0:1782241586.904666:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140109568 00000100:00100000:2.0:1782241586.904672:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140109568 00000100:00100000:2.0:1782241586.904703:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782241586.904711:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:24117:x1868815140109568:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241586.904831:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:24117:x1868815140109568:12345-0@lo:502:mount.lustre.0 Request processed in 121us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241586.904840:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782241586.905208:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241586.905367:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1782241586.905391:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1782241586.905405:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1782241586.905418:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1782241586.905430:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1782241586.905442:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1782241586.905454:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1782241586.905468:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1782241586.905481:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1782241586.905495:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1782241586.905509:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1782241586.905532:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241586.905569:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241586.905686:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219df00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241586.907246:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140109696 00000100:00100000:2.0:1782241586.907255:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140109696 00000100:00100000:2.0:1782241586.907304:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782241586.907313:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:24117:x1868815140109696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241586.907450:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:24117:x1868815140109696:12345-0@lo:502:mount.lustre.0 Request processed in 138us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241586.907458:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782241586.909290:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241586.909378:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1782241586.909393:0:24117:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1782241586.915447:0:24139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241586.915462:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241586.915464:0:24139:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782241586.915471:0:24139:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e4813b000 00000020:00000080:3.0:1782241586.915482:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782241586.915505:0:24139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241586.915509:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241586.915510:0:24139:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1782241586.915513:0:24139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241586.915515:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241586.915516:0:24139:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782241586.915519:0:24139:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e4813b000 00000020:00000080:3.0:1782241586.915521:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782241586.915585:0:24139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241586.915589:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241586.915590:0:24139:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1782241586.915593:0:24139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241586.915604:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241586.915606:0:24139:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782241586.915609:0:24139:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e4813b000 00000020:00000080:3.0:1782241586.915611:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782241586.915630:0:24139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241586.915633:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241586.915634:0:24139:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782241586.915636:0:24139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241586.915638:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241586.915639:0:24139:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1782241586.915642:0:24139:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e4813b000 00000020:00000080:3.0:1782241586.915644:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782241586.915666:0:24139:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241586.915669:0:24139:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241586.915670:0:24139:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1782241586.915673:0:24139:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1782241586.919881:0:24117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1782241586.919935:0:24117:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241586.919959:0:24117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241586.919973:0:24117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241586.920053:0:24117:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782241586.920056:0:24117:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890e4813b000 10000000:01000000:2.0:1782241586.920059:0:24117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890e4813b000 10000000:01000000:2.0:1782241586.920063:0:24117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782241586.920069:0:24117:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e4813b000 from 1 10000000:01000000:2.0:1782241586.920072:0:24117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782241586.920107:0:24117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e1b379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241586.920123:0:24117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e1b379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241586.920132:0:24117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e1b379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241586.920154:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109824:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782241586.920216:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241586.920256:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e477d8540 going to sleep for 11 seconds 00000100:00100000:0.0:1782241586.927601:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140109824 00000100:00100000:0.0:1782241586.927617:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140109824 00000100:00100000:0.0:1782241586.927682:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782241586.927693:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:24117:x1868815140109824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241586.927713:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241586.927731:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b379 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241586.927786:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b379 expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241586.927798:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4499a200/0xc9959f2fb1e1b380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b379 expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241586.927807:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a200, rc 0) 00000100:00100000:0.0:1782241586.927879:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24117:x1868815140109824:12345-0@lo:101:mount.lustre.0 Request processed in 188us (7662us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241586.927886:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782241586.930262:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140109824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241586.930288:0:24117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e1b379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b380 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241586.930301:0:24117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e1b379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b380 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782241586.947172:0:24117:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1782241586.949249:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140109952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241586.949318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241586.949376:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241586.949391:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140109952 00000100:00100000:2.0:1782241586.949397:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140109952 00000100:00100000:2.0:1782241586.949443:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782241586.949524:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140109952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782241586.949558:0:23684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782241586.949604:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140109952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241586.949611:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782241586.949655:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140109952:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1782241586.952369:0:24117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241586.952684:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1782241586.952712:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1782241586.952737:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1782241586.952904:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1782241586.952920:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1782241586.952949:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1782241586.952967:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1782241586.952980:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1782241586.952994:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1782241586.953008:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1782241586.953035:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1782241586.953052:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1782241586.953067:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1782241586.953082:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1782241586.953097:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1782241586.953111:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1782241586.953125:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1782241586.953139:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1782241586.953153:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1782241586.953166:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1782241586.953180:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000100:00100000:2.0:1782241586.954780:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140110080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241586.954857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241586.954904:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140110080 00000100:00100000:2.0:1782241586.954911:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140110080 00000100:00100000:2.0:1782241586.954961:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782241586.954969:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140110080:12345-0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1782241586.954989:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000004:00000024:2.0:1782241586.955000:0:22617:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000040:00080000:3.0:1782241586.955013:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1782241586.955041:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1782241586.955058:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000100:00100000:2.0:1782241586.955065:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140110080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (208us total) trans 0 rc 0/0 00000040:00080000:3.0:1782241586.955072:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000100:00100000:2.0:1782241586.955072:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000040:00080000:3.0:1782241586.955090:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000100:00100000:2.0:1782241586.955124:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140110080:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1782241586.955168:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1782241586.955189:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1782241586.955270:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1782241586.955288:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1782241586.955302:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1782241586.955314:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1782241586.955326:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1782241586.955338:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1782241586.955367:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1782241586.955381:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1782241586.955411:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1782241586.955424:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1782241586.955436:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1782241586.955447:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1782241586.955459:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1782241586.955471:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1782241586.955484:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1782241586.955497:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1782241586.955509:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1782241586.955523:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1782241586.955535:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1782241586.955685:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1782241586.955706:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1782241586.955724:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1782241586.955729:0:24117:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1782241586.962410:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140110208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241586.962482:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241586.962518:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219df00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241586.963343:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140110208 00000100:00100000:2.0:1782241586.963351:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140110208 00000100:00100000:2.0:1782241586.963409:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782241586.963418:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24117:x1868815140110208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241586.963548:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24117:x1868815140110208:12345-0@lo:501:mount.lustre.0 Request processed in 131us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241586.963567:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782241586.963876:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140110208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241586.963913:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140110336:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241586.963956:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241586.963975:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219df00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241586.964619:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140110336 00000100:00100000:2.0:1782241586.964624:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140110336 00000100:00100000:2.0:1782241586.964661:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782241586.964668:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24117:x1868815140110336:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782241586.964798:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24117:x1868815140110336:12345-0@lo:503:mount.lustre.0 Request processed in 129us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241586.964805:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782241586.964906:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140110336:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782241586.965367:0:24117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782241586.965439:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140110464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241586.965478:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241586.965501:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4809c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241586.965743:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140110464 00000100:00100000:2.0:1782241586.965748:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140110464 00000100:00100000:2.0:1782241586.965797:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782241586.965803:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24117:x1868815140110464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241586.965876:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24117:x1868815140110464:12345-0@lo:502:mount.lustre.0 Request processed in 73us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241586.965883:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782241586.969783:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140110464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782241586.970013:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1782241586.970053:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1782241586.970068:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1782241586.970080:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1782241586.970093:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1782241586.970117:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1782241586.970133:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1782241586.970146:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1782241586.970158:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1782241586.970169:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1782241586.970304:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1782241586.970324:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1782241586.970337:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1782241586.970351:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1782241586.970364:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1782241586.970377:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1782241586.970389:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1782241586.970402:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1782241586.970416:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1782241586.970428:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1782241586.970440:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1782241586.970453:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1782241586.970465:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1782241586.970479:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1782241586.970491:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1782241586.970516:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1782241586.970542:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1782241586.970556:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1782241586.971127:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1782241586.971154:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1782241586.971168:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1782241586.971182:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1782241586.971196:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1782241586.971222:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1782241586.971235:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1782241586.971247:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1782241586.971259:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1782241586.971272:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1782241586.971285:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1782241586.971298:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1782241586.971312:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1782241586.971325:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1782241586.971354:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1782241586.971371:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1782241586.971385:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1782241586.971399:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1782241586.971412:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1782241586.971423:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1782241586.971469:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140110592:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241586.971536:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241586.971588:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4809c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241586.971882:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140110592 00000100:00100000:0.0:1782241586.971890:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140110592 00000100:00100000:0.0:1782241586.971941:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782241586.973996:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24117:x1868815140110592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241586.974148:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24117:x1868815140110592:12345-0@lo:502:mount.lustre.0 Request processed in 161us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241586.980262:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140110592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782241586.980502:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1782241586.980530:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1782241586.980579:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140110720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241586.980652:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241586.980693:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e778630c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241586.985395:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140110720 00000100:00100000:3.0:1782241586.985413:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140110720 00000100:00100000:3.0:1782241586.985458:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782241586.985468:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24117:x1868815140110720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241586.985645:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24117:x1868815140110720:12345-0@lo:502:mount.lustre.0 Request processed in 177us (4992us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241586.985658:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782241586.985932:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140110720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782241586.986035:0:24117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1782241586.986051:0:24117:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1782241586.988032:0:24145:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782241586.988054:0:24145:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff890e817419c0) 00000020:00000080:2.0:1782241586.988078:0:24145:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1782241586.988279:0:24145:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e4813b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782241586.988283:0:24145:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e4813b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782241586.988286:0:24145:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e4813b000 3 00010000:00080000:2.0:1782241586.988313:0:24145:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d4814f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.158@tcp at head 00010000:00010000:2.0:1782241586.992393:0:24145:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1782241586.992496:0:24145:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1782241586.992540:0:24145:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782241586.992554:0:24145:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc9959f2fb1e1b38e 00000100:00080000:2.0:1782241586.992566:0:24145:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782241586.992572:0:24145:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff890d4814f800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241586.992604:0:24145:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f685f80 x1868815140110848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241586.992627:0:24145:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782241586.992828:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140110848:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782241586.992902:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782241586.992964:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241586.992969:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241586.992972:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241586.992975:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241586.993008:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241586.993012:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241586.993014:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241586.993029:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782241586.995507:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782241586.995586:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140110976:0@lo:400:kworker.0 00000100:00100000:0.0:1782241586.995656:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241586.995688:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241586.995695:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140111104:0@lo:400:kworker.0 00000100:00100000:0.0:1782241586.995720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241586.996155:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140110848 00000100:00100000:0.0:1782241586.996163:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140110848 00000100:00100000:0.0:1782241586.996184:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140110976 00000100:00100000:0.0:1782241586.996187:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140110976 00000100:00100000:0.0:1782241586.996279:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140111104 00000100:00100000:0.0:1782241586.996283:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140111104 00000100:00100000:0.0:1782241586.996300:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241586.996307:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140110976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241586.996365:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140110976:12345-0@lo:400:kworker.0 Request processed in 57us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241586.996372:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241586.996385:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241586.996392:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140111104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241586.996418:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140111104:12345-0@lo:400:kworker.0 Request processed in 27us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241586.996424:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241586.996434:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241586.996439:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815140110848:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1782241586.996460:0:22612:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:0.0:1782241586.996491:0:22612:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc9959f2fb1e1b395 00000004:00100000:0.0:1782241586.996505:0:22612:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782241586.996538:0:22612:0:(import.c:65:import_set_state_nolock()) ffff890e436db800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782241586.997849:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1868815140110848:12345-0@lo:38:llog_process_th.0 Request processed in 1401us (4940us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241586.997858:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782241586.997905:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7d635880 x1868815140111104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241586.997919:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140111104:0@lo:400:kworker.0 00010000:00080000:0.0:1782241586.997931:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7d636300 x1868815140110976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241586.997939:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140110976:0@lo:400:kworker.0 00000020:01000004:3.0:1782241586.998817:0:24145:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1782241586.998838:0:24145:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff890e43fecd40) 00000020:00000080:3.0:1782241586.998860:0:24145:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1782241586.999044:0:24145:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e4813b000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782241586.999049:0:24145:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e4813b000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782241586.999052:0:24145:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e4813b000 3 00010000:00080000:3.0:1782241586.999088:0:24145:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d45a64000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.158@tcp at head 00010000:00080000:2.0:1782241586.999908:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7f685f80 x1868815140110848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241586.999919:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782241586.999928:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1782241586.999935:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782241586.999940:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782241586.999944:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d4814f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782241586.999950:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140110848:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1782241587.008690:0:24145:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1782241587.008839:0:24145:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1782241587.008887:0:24145:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782241587.008899:0:24145:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc9959f2fb1e1b3a3 00000100:00080000:3.0:1782241587.008910:0:24145:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782241587.008915:0:24145:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff890d45a64000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241587.008955:0:24145:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7d634000 x1868815140111232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241587.008983:0:24145:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1782241587.009036:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241587.009041:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241587.009043:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241587.009047:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241587.009050:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241587.009053:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241587.009055:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241587.009058:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782241587.009829:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1868815140111232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782241587.009898:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241587.011692:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140111232 00000100:00100000:2.0:1782241587.011714:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140111232 00000100:00100000:2.0:1782241587.011785:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782241587.011792:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140111232:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1782241587.011820:0:22611:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:2.0:1782241587.011854:0:22611:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc9959f2fb1e1b3aa 00000004:00100000:2.0:1782241587.011870:0:22611:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782241587.011903:0:22611:0:(import.c:65:import_set_state_nolock()) ffff890d48148800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241587.011978:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1868815140111232:12345-0@lo:38:llog_process_th.0 Request processed in 185us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241587.011986:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782241587.012041:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7d634000 x1868815140111232/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241587.012053:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782241587.012061:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1782241587.012069:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782241587.012074:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1782241587.012076:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d45a64000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782241587.012082:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1868815140111232:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1782241587.021053:0:24145:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1782241587.021928:0:24117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1782241587.022013:0:24117:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782241587.022039:0:24117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e1b379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b380 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.022053:0:24117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e1b379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b380 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782241587.022103:0:24117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782241587.022657:0:24117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241587.022659:0:24117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241587.022660:0:24117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241587.022661:0:24117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241587.022663:0:24117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241587.022664:0:24117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241587.022666:0:24117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241587.022668:0:24117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782241587.022671:0:24117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1782241587.022674:0:24117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782241587.022675:0:24117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241587.022676:0:24117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241587.022677:0:24117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241587.022679:0:24117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241587.022680:0:24117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241587.022681:0:24117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241587.022682:0:24117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241587.022683:0:24117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782241587.022709:0:24117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782241587.022730:0:24117:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140111360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782241587.022922:0:24117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241587.023008:0:24117:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863180 going to sleep for 11 seconds 00000100:00100000:0.0:1782241587.037552:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140111360 00000100:00100000:0.0:1782241587.037568:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140111360 00000100:00100000:1.0:1782241587.038492:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782241587.038505:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24117:x1868815140111360:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782241587.038537:0:22605:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782241587.038551:0:22605:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782241587.045507:0:22605:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782241587.045544:0:22605:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782241587.045656:0:22627:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782241587.045661:0:22627:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782241587.045684:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.045702:0:22627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1b2fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b2f4 expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.045710:0:22627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1b309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b302 expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.045718:0:22627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.045800:0:22627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1b309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b302 expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.045814:0:22627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1b309 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b302 expref: 21 pid: 22606 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241587.045830:0:22627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140111488:0@lo:104: 00000100:00100000:2.0:1782241587.045894:0:22627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241587.045943:0:22627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1b2fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b2f4 expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.045952:0:22627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1b2fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2f4 expref: 21 pid: 22606 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241587.045961:0:22627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140111616:0@lo:104: 00000100:00100000:2.0:1782241587.045985:0:22627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241587.046004:0:22627:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782241587.046041:0:22596:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782241587.046058:0:22596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140111488 00000100:00100000:2.0:1782241587.046064:0:22596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140111488 00000100:00100000:2.0:1782241587.046098:0:22596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140111616 00000100:00100000:2.0:1782241587.046101:0:22596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140111616 00000100:00100000:2.0:1782241587.046132:0:22596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241587.046139:0:22596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+4:22627:x1868815140111488:12345-0@lo:104: 00010000:00010000:2.0:1782241587.046152:0:22596:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046201:0:22596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782241587.046213:0:22596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+4:22627:x1868815140111488:12345-0@lo:104: Request processed in 74us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241587.046220:0:22596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241587.046238:0:22596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782241587.046244:0:22596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:22627:x1868815140111616:12345-0@lo:104: 00010000:00010000:2.0:1782241587.046252:0:22596:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046286:0:22596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782241587.046290:0:22596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:22627:x1868815140111616:12345-0@lo:104: Request processed in 47us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241587.046295:0:22596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1782241587.046331:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782241587.046336:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046343:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b800 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241587.046346:0:22600:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046355:0:22600:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241587.046362:0:22600:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241587.046367:0:22600:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782241587.046393:0:22600:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046410:0:22600:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241587.046430:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046437:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4499b800/0xc9959f2fb1e1b302 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b309 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046449:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241587.046452:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046458:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310000 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241587.046461:0:22600:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046467:0:22600:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241587.046474:0:22600:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241587.046480:0:22600:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782241587.046493:0:22600:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046499:0:22600:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241587.046505:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046511:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e7c310000/0xc9959f2fb1e1b2f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b2fb expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046530:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241587.046532:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241587.046534:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241587.046540:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241587.046559:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140111744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241587.046605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241587.046627:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241587.046633:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140111872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241587.046656:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241587.046685:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140111744 00000100:00100000:2.0:1782241587.046689:0:22599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140111744 00010000:00010000:2.0:1782241587.046705:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1b309 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b302 expref: 22 pid: 22606 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241587.046723:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140111872 00000100:00100000:2.0:1782241587.046726:0:22599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140111872 00010000:00010000:2.0:1782241587.046734:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1b2fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2f4 expref: 23 pid: 22606 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241587.046748:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241587.046753:0:22599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:3639:x1868815140111744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241587.046780:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241587.046784:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1b309 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b302 expref: 23 pid: 22606 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046794:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1b309 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b302 expref: 23 pid: 22606 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046818:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241587.046845:0:22599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:3639:x1868815140111744:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241587.046851:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241587.046864:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782241587.046870:0:22599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:3639:x1868815140111872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241587.046878:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241587.046882:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1b2fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2f4 expref: 22 pid: 22606 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046891:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1b2fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2f4 expref: 22 pid: 22606 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046901:0:22599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046908:0:22599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782241587.046919:0:22599:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011186535s 00010000:00010000:2.0:1782241587.046924:0:22599:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046931:0:22599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046937:0:22599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046953:0:22599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046959:0:22599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241587.046962:0:22599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046970:0:22599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046978:0:22599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.046987:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241587.047010:0:22599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:3639:x1868815140111872:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241587.047027:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782241587.047088:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140111872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241587.047097:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140111744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241587.047122:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1b309 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b302 expref: 21 pid: 22606 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241587.047133:0:22627:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140111488:0@lo:104: 00010000:00010000:2.0:1782241587.047142:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1b2fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b2f4 expref: 20 pid: 22606 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241587.047149:0:22627:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140111616:0@lo:104: 00010000:00010000:2.0:1782241587.047169:0:22627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.047178:0:22627:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.047184:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241587.047190:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b3b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241587.048624:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:24117:x1868815140111360:12345-0@lo:253:mount.lustre.0 Request processed in 10116us (25697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241587.048636:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782241587.049393:0:24117:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24117:1868815140111360:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782241587.049407:0:24117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782241587.049410:0:24117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782241587.049412:0:24117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241587.049413:0:24117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241587.049414:0:24117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241587.049415:0:24117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241587.049416:0:24117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241587.049418:0:24117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241587.049420:0:24117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241587.049421:0:24117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782241587.049434:0:24117:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1782241587.054123:0:24117:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1782241587.057490:0:24117:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1782241587.057499:0:24117:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1782241587.057536:0:24117:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782241587.057581:0:24117:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782241587.057601:0:24117:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1782241587.057619:0:24117:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1782241587.058601:0:24117:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241587.061488:0:24117:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782241587.974091:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782241588.136094:0:24198:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241588.136965:0:24198:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1782241588.231828:0:22609:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782241588.231838:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d46921800 from 13 10000000:01000000:2.0:1782241588.231842:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782241588.231889:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241588.231899:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241588.231910:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241588.231933:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140112000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241588.232013:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241588.232053:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d41804cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241588.232128:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140112000 00000100:00100000:1.0:1782241588.232136:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140112000 00000100:00100000:1.0:1782241588.232178:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782241588.232187:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+19:22609:x1868815140112000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241588.232199:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241588.232212:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b3bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b3b8 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241588.232234:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b3bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b3b8 expref: 20 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241588.232244:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b3bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b3b8 expref: 20 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241588.232254:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c311200, rc 0) 00000100:00100000:1.0:1782241588.232289:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:22609:x1868815140112000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241588.232295:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782241588.232378:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140112000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241588.232392:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241588.232400:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241588.232467:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140112128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782241588.232494:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241588.232513:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d41804cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241588.232598:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140112128 00000100:00100000:1.0:1782241588.232602:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140112128 00000100:00100000:1.0:1782241588.232631:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782241588.232638:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:22609:x1868815140112128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782241588.232651:0:22605:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782241588.232667:0:22605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782241588.232670:0:22605:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1782241588.232740:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:22609:x1868815140112128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241588.232747:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782241588.232791:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140112128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782241588.232839:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782241588.232845:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241588.232853:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241588.232861:0:22609:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782241588.232863:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d46713800 from 13 10000000:01000000:1.0:1782241588.232865:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782241588.232878:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241588.232885:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241588.232892:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241588.232902:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140112256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782241588.232925:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241588.232937:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4809c000 going to sleep for 11 seconds 00000100:00100000:1.0:1782241588.232948:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140112256 00000100:00100000:1.0:1782241588.232951:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140112256 00000100:00100000:1.0:1782241588.232969:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782241588.232974:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:22609:x1868815140112256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241588.232985:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241588.233005:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b3cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b3c6 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241588.233019:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b3cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b3c6 expref: 21 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241588.233027:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b3cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b3c6 expref: 21 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241588.233034:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c310600, rc 0) 00000100:00100000:1.0:1782241588.233059:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:22609:x1868815140112256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241588.233065:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782241588.233090:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140112256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241588.233099:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241588.233107:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241588.233136:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140112384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782241588.233158:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241588.233169:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4809c000 going to sleep for 11 seconds 00000100:00100000:1.0:1782241588.233178:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140112384 00000100:00100000:1.0:1782241588.233180:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140112384 00000100:00100000:1.0:1782241588.233196:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782241588.233201:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:22609:x1868815140112384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782241588.233214:0:22604:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782241588.233222:0:22604:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782241588.233225:0:22604:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1782241588.233272:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:22609:x1868815140112384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 70us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241588.233278:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782241588.233301:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140112384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782241588.233330:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782241588.233335:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241588.233342:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241588.996840:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782241589.447154:0:22647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782241590.020908:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241591.047471:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241592.077953:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140112512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241592.078032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241592.078087:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241592.078093:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140112640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241592.078116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241592.078143:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241592.078159:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140112512 00000100:00100000:2.0:1782241592.078165:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140112512 00000100:00100000:2.0:1782241592.078199:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140112640 00000100:00100000:2.0:1782241592.078203:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140112640 00000100:00100000:2.0:1782241592.078219:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782241592.078227:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140112512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782241592.078260:0:22616:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782241592.078299:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140112512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241592.078306:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782241592.078321:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782241592.078327:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140112640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782241592.078342:0:22616:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782241592.078364:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140112640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 38us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241592.078370:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782241592.078430:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140112640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241592.078443:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140112512:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1782241592.079929:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241592.079943:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241592.079946:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241592.079949:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241592.079961:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241592.079964:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241592.079967:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241592.079970:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782241592.080016:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140112768:0@lo:400:kworker.0 00000100:00100000:2.0:1782241592.080069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241592.080286:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140113280:0@lo:400:kworker.0 00000100:00100000:2.0:1782241592.080317:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241592.080391:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241592.080399:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140112896:0@lo:400:kworker.0 00000100:00100000:2.0:1782241592.080423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241592.084932:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140113024:0@lo:400:kworker.0 00000100:00100000:2.0:1782241592.087569:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815140113152:0@lo:400:kworker.0 00000100:00100000:2.0:1782241592.087629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241592.088784:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140113280 00000100:00100000:0.0:1782241592.088795:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140113280 00000100:00100000:0.0:1782241592.088868:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140112896 00000100:00100000:0.0:1782241592.088872:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140112896 00000100:00100000:0.0:1782241592.088891:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782241592.090460:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140113280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241592.090565:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140113280:12345-0@lo:400:kworker.0 Request processed in 1664us (10245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241592.090576:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782241592.090610:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782241592.090619:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140112896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241592.090649:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140112896:12345-0@lo:400:kworker.0 Request processed in 33us (10225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241592.090656:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782241592.091957:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140112768 00000100:00100000:3.0:1782241592.091968:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140112768 00000100:00100000:3.0:1782241592.092022:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782241592.092030:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:3639:x1868815140112768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241592.092085:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:3639:x1868815140112768:12345-0@lo:400:kworker.0 Request processed in 57us (12016us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241592.092092:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1782241592.095129:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241592.095482:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140113152 00000100:00100000:2.0:1782241592.095492:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140113152 00000100:00100000:2.0:1782241592.095547:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782241592.095558:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815140113152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241592.095628:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815140113152:12345-0@lo:400:kworker.0 Request processed in 71us (7998us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241592.095635:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1782241592.095666:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241592.095695:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241592.095731:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140113024 00000100:00100000:2.0:1782241592.095735:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140113024 00000100:00100000:3.0:1782241592.097255:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782241592.097275:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140113024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241592.097360:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140113024:12345-0@lo:400:kworker.0 Request processed in 93us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241592.097392:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1782241592.098866:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e77fce300 x1868815140113024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241592.098885:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140113024:0@lo:400:kworker.0 00010000:00080000:2.0:1782241592.098944:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e77fcea00 x1868815140112896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241592.098954:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140112896:0@lo:400:kworker.0 00000100:00100000:2.0:1782241592.098965:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140112768:0@lo:400:kworker.0 00010000:00080000:2.0:1782241592.098976:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e77fcc700 x1868815140113280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241592.098984:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140113280:0@lo:400:kworker.0 00010000:00080000:2.0:1782241592.099018:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e77fcc380 x1868815140113152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241592.099026:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815140113152:0@lo:400:kworker.0 00000040:00080000:0.0:1782241593.029948:0:23364:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782241593.094929:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241594.118623:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782241594.382006:0:24488:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782241595.141994:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782241595.485848:0:24540:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241595.486077:0:24540:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782241596.165152:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241596.228899:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241581/real 1782241581] req@ffff890e7f686300 x1868815140106752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241596 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241596.228943:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e7f686300 x1868815140106752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241596 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241596.228954:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241581/real 1782241581] req@ffff890e7f686d80 x1868815140106880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241596 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241596.228966:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e7f686d80 x1868815140106880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241596 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782241596.228993:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e436dd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241596.229026:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782241596.229031:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140106752:0@lo:8:kworker.0 00000100:00080000:1.0:1782241596.229038:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241596.229043:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782241596.229046:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140106880:0@lo:8:kworker.0 00000100:00080000:0.0:1782241596.229249:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241596.229254:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241596.229257:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1782241596.229343:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241596.229370:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140113408:0@lo:400:kworker.0 00000100:00100000:1.0:1782241596.229459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241596.229531:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140113408 00000100:00100000:1.0:1782241596.229541:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140113408 00000100:00100000:1.0:1782241596.229598:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782241596.229607:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:3639:x1868815140113408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241596.229668:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:3639:x1868815140113408:12345-0@lo:400:kworker.0 Request processed in 61us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241596.229677:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782241596.229748:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140113408:0@lo:400:kworker.0 00000100:00100000:1.0:1782241596.229808:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140113536:0@lo:400:kworker.0 00000100:00100000:1.0:1782241596.229852:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241596.229888:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140113536 00000100:00100000:1.0:1782241596.229892:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140113536 00000100:00100000:1.0:1782241596.229921:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782241596.229928:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140113536:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782241596.229963:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782241596.229969:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140113536:12345-0@lo:400:kworker.0 Request processed in 41us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241596.229975:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1782241596.229991:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241596.229995:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782241596.229998:0:36:0:(import.c:65:import_set_state_nolock()) ffff890e436dd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241596.230004:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 645 00000100:00080000:0.0:1782241596.230008:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1782241596.230013:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140113536:0@lo:400:kworker.0 00000100:00080000:0.0:1782241596.230013:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff890e436dd800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241596.230023:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782241596.230028:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140113664:0@lo:400:kworker.0 00000100:00100000:0.0:1782241596.230040:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48836a00 x1868815140113920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782241596.230052:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782241596.230055:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241596.230058:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782241596.230060:0:36:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241596.230064:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 645 00000100:00080000:0.0:1782241596.230066:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1782241596.230070:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890e449fb000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241596.230078:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140113664 00000100:00100000:1.0:1782241596.230082:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140113664 00000100:00100000:0.0:1782241596.230096:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48835180 x1868815140114048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782241596.230110:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782241596.230116:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140113664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241596.230144:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140114432:0@lo:400:kworker.0 00000100:00100000:1.0:1782241596.230146:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140113664:12345-0@lo:400:kworker.0 Request processed in 30us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241596.230153:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782241596.230175:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140114304:0@lo:400:kworker.0 00000100:00100000:0.0:1782241596.230175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241596.230202:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241596.230215:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140114432 00000100:00100000:0.0:1782241596.230218:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140114432 00010000:00080000:1.0:1782241596.230221:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d48835880 x1868815140113664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241596.230230:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140113664:0@lo:400:kworker.0 00000100:00100000:1.0:1782241596.230248:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140114304 00000100:00100000:1.0:1782241596.230251:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140114304 00000100:00100000:0.0:1782241596.230252:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782241596.230266:0:22612:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782241596.230275:0:22612:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1782241596.230367:0:22613:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782241596.230376:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782241596.230382:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140114304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241596.230391:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140114176:0@lo:400:kworker.0 00000100:00100000:1.0:1782241596.230417:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140114304:12345-0@lo:400:kworker.0 Request processed in 36us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241596.230419:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241596.230423:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782241596.230435:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241596.230440:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140113792:0@lo:400:kworker.0 00000100:00100000:1.0:1782241596.230441:0:22613:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782241596.230445:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140114176 00000100:00100000:1.0:1782241596.230448:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140114176 00000100:00100000:1.0:1782241596.230460:0:22613:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1782241596.230462:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241596.230465:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782241596.230471:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140114176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241596.230487:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140113792 00000100:00100000:3.0:1782241596.230491:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140113792 00000100:00100000:1.0:1782241596.230503:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140114176:12345-0@lo:400:kworker.0 Request processed in 32us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241596.230509:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241596.230515:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782241596.230521:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140113792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241596.230526:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140113920:0@lo:8:kworker.0 00000100:00100000:3.0:1782241596.230552:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140113792:12345-0@lo:400:kworker.0 Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241596.230555:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241596.230558:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782241596.230578:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140114048:0@lo:8:kworker.0 00000100:00100000:3.0:1782241596.230582:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140113792:0@lo:400:kworker.0 00010000:00080000:3.0:1782241596.230593:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d48837100 x1868815140114176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241596.230602:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140114176:0@lo:400:kworker.0 00000100:00100000:1.0:1782241596.230605:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241596.230641:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140113920 00000100:00100000:1.0:1782241596.230645:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140113920 00000100:00100000:1.0:1782241596.230672:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140114048 00000100:00100000:1.0:1782241596.230675:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140114048 00000100:00100000:1.0:1782241596.230686:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241596.230691:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1868815140113920:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1782241596.230708:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815140114432:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1782241596.230721:0:24123:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 659 last 0 00000100:00100000:0.0:1782241596.230747:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815140114432:12345-0@lo:400:kworker.0 Request processed in 489us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241596.230753:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00000080:1.0:1782241596.230774:0:24123:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1b3d4 00000100:00080000:0.0:1782241596.230791:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00100000:1.0:1782241596.230794:0:24123:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff890d47bac000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00000100:00080000:0.0:1782241596.230796:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00080000:1.0:1782241596.230799:0:24123:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1782241596.230802:0:24123:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1782241596.230815:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d48837800 x1868815140114432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241596.230823:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140114432:0@lo:400:kworker.0 00002000:00080000:1.0:1782241596.231055:0:24123:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1782241596.231084:0:24123:0:(import.c:65:import_set_state_nolock()) ffff890d47baf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241596.231135:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1868815140113920:12345-0@lo:8:kworker.0 Request processed in 442us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241596.231148:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782241596.231154:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d48836a00 x1868815140113920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241596.231160:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782241596.231163:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1782241596.231165:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1868815140114048:12345-0@lo:8:kworker.0 00000100:00080000:0.0:1782241596.231170:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00010000:00020000:1.0:1782241596.231176:0:24123:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1782241596.231179:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782241596.231185:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1782241596.231187:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e436dd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782241596.231216:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782241596.231223:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140113920:0@lo:8:kworker.0 00000004:00080000:3.0:1782241596.231368:0:23354:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1782241596.231389:0:23354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23354:1868815140114688:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1782241596.231422:0:23354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241596.231438:0:23354:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e508853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241596.231484:0:24124:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1782241596.231491:0:24124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1782241596.231508:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241596.231518:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140114560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241596.231543:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241596.232065:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140114688 00000004:00080000:2.0:1782241596.232581:0:23353:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782241596.232687:0:23353:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 659490929529ns, next at 0ns, rc = 0 00080000:00080000:2.0:1782241596.232695:0:23353:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1782241596.232781:0:24126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140114560 00000100:00100000:2.0:1782241596.232789:0:24126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140114560 00000100:00100000:2.0:1782241596.232851:0:24126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241596.232870:0:24126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1868815140114560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241596.232902:0:24126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1782241596.232973:0:24126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1868815140114560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241596.232980:0:24126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1782241596.233020:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782241596.233053:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7d637b80 x1868815140114560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241596.233072:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140114560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241596.233395:0:24124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140114688 00000100:00100000:0.0:1782241596.233433:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782241596.233441:0:24124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23354:x1868815140114688:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:3.0:1782241596.236373:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d48834000 x1868815140114304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241596.236413:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140114304:0@lo:400:kworker.0 00000004:00080000:3.0:1782241596.238935:0:23345:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1782241596.245725:0:24124:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1782241596.245738:0:24124:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1782241596.245899:0:24124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23354:x1868815140114688:12345-0@lo:7:osp-pre-0-1.0 Request processed in 12450us (14466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241596.245913:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782241596.246037:0:23354:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7d634700 x1868815140114688/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782241612 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241596.246056:0:23354:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23354:1868815140114688:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1782241596.246084:0:23354:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1782241596.246139:0:23354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23354:1868815140114816:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1782241596.246179:0:23354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241596.246219:0:23354:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e508853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241596.246420:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140114816 00000100:00100000:0.0:1782241596.246427:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140114816 00000100:00100000:0.0:1782241596.246480:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241596.246489:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23354:x1868815140114816:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1782241596.246524:0:24572:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1782241596.246561:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23354:x1868815140114816:12345-0@lo:5:osp-pre-0-1.0 Request processed in 72us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241596.246567:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782241596.246631:0:23354:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7d634700 x1868815140114816/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241612 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241596.246640:0:23354:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23354:1868815140114816:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1782241596.246650:0:23354:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1782241596.246676:0:23354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23354:1868815140114944:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1782241596.246698:0:23354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241596.247102:0:23354:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e508853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241596.253241:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140114944 00000100:00100000:0.0:1782241596.253256:0:24124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140114944 00000100:00100000:0.0:1782241596.253344:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782241596.253495:0:24124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23354:x1868815140114944:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1782241596.253561:0:24124:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1782241596.265732:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1868815140114048:12345-0@lo:8:kworker.0 Request processed in 34554us (35114us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782241596.265752:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1782241596.266532:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782241596.266542:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782241596.266547:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140114048:0@lo:8:kworker.0 00000001:00080000:1.0:1782241596.296809:0:24119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1782241596.296827:0:24119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1782241596.297082:0:24124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23354:x1868815140114944:12345-0@lo:5:osp-pre-0-1.0 Request processed in 43586us (50375us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1782241596.297105:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782241596.297151:0:23354:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7d634700 x1868815140114944/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241612 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241596.297165:0:23354:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1782241596.297174:0:23354:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23354:1868815140114944:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1782241596.297196:0:23354:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1782241596.297276:0:23354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23354:1868815140115072:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1782241596.297337:0:23354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241596.297547:0:23354:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e508853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241596.297791:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140115072 00000100:00100000:1.0:1782241596.297801:0:22623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140115072 00000100:00100000:1.0:1782241596.297860:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241596.297871:0:22623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23354:x1868815140115072:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1782241596.298490:0:22623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23354:x1868815140115072:12345-0@lo:900:osp-pre-0-1.0 Request processed in 617us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241596.298500:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782241596.299247:0:23354:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7d634700 x1868815140115072/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782241612 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241596.299265:0:23354:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23354:1868815140115072:0@lo:900:osp-pre-0-1.0 00000020:00000004:0.0:1782241596.624001:0:24594:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241596.625095:0:24594:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1782241597.189023:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241597.189059:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140115200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241597.189155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241597.189230:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140115200 00000100:00100000:0.0:1782241597.189242:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140115200 00000100:00100000:0.0:1782241597.189313:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782241597.189323:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140115200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241597.189372:0:22617:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1782241597.189425:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140115200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241597.189434:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782241597.189496:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140115200:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782241597.189614:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241597.189691:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140115328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241597.189723:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241597.189969:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140115328 00000100:00100000:2.0:1782241597.189975:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140115328 00000100:00100000:2.0:1782241597.191009:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782241597.191027:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140115328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782241597.191068:0:22616:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782241597.191148:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140115328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241597.191156:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782241597.191257:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140115328:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1782241598.214028:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241599.236982:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782241599.695599:0:22647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782241600.263195:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241601.286126:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241601.286155:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140115456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241601.288665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782241601.290903:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1782241601.291450:0:24126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140115456 00000100:00100000:3.0:1782241601.291465:0:24126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140115456 00000100:00080000:2.0:1782241601.291465:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241601.291468:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241601.291471:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241601.291504:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241601.291508:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782241601.291512:0:8:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241601.291523:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:2.0:1782241601.291530:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1782241601.291557:0:24126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782241601.291572:0:24126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140115456:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782241601.291609:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890e449fb000 using connection 192.168.204.158@tcp/0@lo 00002000:00000024:3.0:1782241601.291619:0:24126:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1782241601.291636:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e77fced80 x1868815140116096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241601.291687:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241601.291713:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140116096:0@lo:8:kworker.0 00000100:00100000:3.0:1782241601.291718:0:24126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140115456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (5455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241601.291725:0:24126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241601.291792:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241601.292672:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140116096 00000100:00100000:3.0:1782241601.292681:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140116096 00000100:00100000:3.0:1782241601.292717:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782241601.292725:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1868815140116096:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1782241601.292808:0:24125:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782241601.292874:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1868815140116096:12345-0@lo:8:kworker.0 Request processed in 148us (1082us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782241601.292880:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241601.293040:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140115712:0@lo:400:kworker.0 00000100:00100000:0.0:1782241601.293580:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140115584:0@lo:400:kworker.0 00000100:00080000:2.0:1782241601.293642:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782241601.293649:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782241601.293652:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140116096:0@lo:8:kworker.0 00000100:00100000:2.0:1782241601.294680:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140115840:0@lo:400:kworker.0 00000100:00100000:2.0:1782241601.294773:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241601.294820:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140116480:0@lo:400:kworker.0 00000100:00100000:2.0:1782241601.294844:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241601.294873:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241601.294881:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140115968:0@lo:400:kworker.0 00000100:00100000:2.0:1782241601.294929:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241601.297202:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140115840 00000100:00100000:3.0:1782241601.297223:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140115840 00000100:00100000:3.0:1782241601.297342:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140116480 00000100:00100000:3.0:1782241601.297347:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140116480 00000100:00100000:3.0:1782241601.297396:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782241601.297408:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140115840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241601.297534:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140115840:12345-0@lo:400:kworker.0 Request processed in 128us (2775us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241601.297545:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782241601.297551:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782241601.297556:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140116480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241601.297595:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140116480:12345-0@lo:400:kworker.0 Request processed in 43us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241601.297602:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1782241601.297622:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1782241601.297669:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e77fcea00 x1868815140115840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241601.297687:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140115840:0@lo:400:kworker.0 00010000:00080000:2.0:1782241601.297701:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e77fcd500 x1868815140116480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241601.297709:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140116480:0@lo:400:kworker.0 00000100:00100000:1.0:1782241601.298125:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241601.298201:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140116352:0@lo:400:kworker.0 00000100:00100000:1.0:1782241601.298244:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241601.298612:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241601.298640:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140116224:0@lo:400:kworker.0 00000100:00100000:0.0:1782241601.298666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782241601.298718:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7d634700 x1868815140115456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241601.298750:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140115456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241601.298796:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140116352 00000100:00100000:0.0:1782241601.298802:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140116352 00000100:00100000:0.0:1782241601.298840:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140116224 00000100:00100000:0.0:1782241601.298843:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140116224 00000100:00100000:0.0:1782241601.298857:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782241601.298865:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140116352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241601.298933:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140116352:12345-0@lo:400:kworker.0 Request processed in 67us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241601.298940:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782241601.298957:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782241601.298963:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140116224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241601.298991:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140116224:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241601.298997:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782241601.299015:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140115968 00000100:00100000:0.0:1782241601.299019:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140115968 00000100:00100000:0.0:1782241601.299040:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140115712 00000100:00100000:0.0:1782241601.299043:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140115712 00000100:00100000:0.0:1782241601.299055:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782241601.299060:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140115968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241601.299435:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140115968:12345-0@lo:400:kworker.0 Request processed in 372us (4503us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241601.299442:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782241601.299456:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782241601.299463:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140115712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241601.299518:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140115712:12345-0@lo:400:kworker.0 Request processed in 55us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241601.299525:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1782241601.299605:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782241601.299636:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e77fcf100 x1868815140116224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241601.299648:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140116224:0@lo:400:kworker.0 00000100:00100000:2.0:1782241601.299818:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140115968:0@lo:400:kworker.0 00000100:00100000:1.0:1782241601.299899:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140115584 00000100:00100000:1.0:1782241601.299905:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140115584 00000100:00100000:1.0:1782241601.299956:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782241601.299964:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:3639:x1868815140115584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241601.300018:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:3639:x1868815140115584:12345-0@lo:400:kworker.0 Request processed in 54us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241601.300025:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782241601.300080:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140115712:0@lo:400:kworker.0 00010000:00080000:1.0:1782241601.300094:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e77fce680 x1868815140116352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241601.300104:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140116352:0@lo:400:kworker.0 00000100:00100000:0.0:1782241601.300560:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140115584:0@lo:400:kworker.0 00000100:00100000:0.0:1782241602.314503:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140116608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241602.314603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241602.314681:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140116608 00000100:00100000:0.0:1782241602.314691:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140116608 00000100:00100000:0.0:1782241602.314815:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782241602.314828:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140116608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241602.314876:0:23684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782241602.314937:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140116608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241602.314945:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782241602.315027:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140116736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241602.315057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241602.315093:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140116736 00000100:00100000:0.0:1782241602.315098:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140116736 00000100:00100000:0.0:1782241602.315122:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782241602.315128:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140116736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241602.315612:0:22617:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1782241602.315663:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140116736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 534us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241602.315671:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782241602.315739:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140116736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241602.315808:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140116608:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782241602.316008:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782241603.274195:0:23364:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782241603.337050:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241603.345408:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241583/real 1782241583] req@ffff890e7f686a00 x1868815140107648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241603.345443:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e7f686a00 x1868815140107648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241603.345453:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241583/real 1782241583] req@ffff890e7f684380 x1868815140107776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241603 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241603.345464:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e7f684380 x1868815140107776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241603 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782241603.345483:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d47b7a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241603.345505:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782241603.345509:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140107648:0@lo:8:kworker.0 00000100:00080000:1.0:1782241603.345514:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48885000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241603.345519:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782241603.345521:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140107776:0@lo:8:kworker.0 00000100:00080000:0.0:1782241603.345642:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241603.345646:0:22059:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782241603.345649:0:22059:0:(import.c:65:import_set_state_nolock()) ffff890d47b7a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241603.345654:0:22059:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 647 00000100:00080000:0.0:1782241603.345659:0:22059:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1782241603.345665:0:22059:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff890d47b7a800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241603.345684:0:22059:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48834000 x1868815140117120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241603.345705:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241603.345708:0:22059:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782241603.345710:0:22059:0:(import.c:65:import_set_state_nolock()) ffff890d48885000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241603.345713:0:22059:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 647 00000100:00080000:0.0:1782241603.345715:0:22059:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1782241603.345719:0:22059:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff890d48885000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241603.345729:0:22059:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48837100 x1868815140117248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241603.345779:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241603.345783:0:22059:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782241603.345784:0:22059:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241603.345787:0:22059:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 664 00000100:00080000:0.0:1782241603.345790:0:22059:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1782241603.345793:0:22059:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890e449fb000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241603.345805:0:22059:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e778dd500 x1868815140117760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241603.345843:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140117504:0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.345915:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241603.345953:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140118144:0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.345977:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241603.345996:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782241603.346001:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140116864:0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346027:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241603.346050:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140117632:0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241603.346098:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140116992:0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346120:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241603.346136:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140117888:0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346154:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241603.346170:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782241603.346174:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140117376:0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346192:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241603.346205:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140118016:0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241603.346259:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140117504 00000100:00100000:0.0:1782241603.346266:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140117504 00000100:00100000:0.0:1782241603.346305:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140116992 00000100:00100000:0.0:1782241603.346308:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140116992 00000100:00100000:0.0:1782241603.346324:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782241603.346332:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140117504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346382:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140117504:12345-0@lo:400:kworker.0 Request processed in 49us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241603.346388:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782241603.346414:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782241603.346420:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140116992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346453:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140116992:12345-0@lo:400:kworker.0 Request processed in 34us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241603.346460:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782241603.346479:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140118144 00000100:00100000:0.0:1782241603.346483:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140118144 00000100:00100000:0.0:1782241603.346508:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140117888 00000100:00100000:0.0:1782241603.346511:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140117888 00000100:00100000:0.0:1782241603.346522:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140117376 00000100:00100000:0.0:1782241603.346524:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140117376 00000100:00100000:0.0:1782241603.346534:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140118016 00000100:00100000:0.0:1782241603.346536:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140118016 00000100:00100000:0.0:1782241603.346549:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782241603.346554:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140118144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346583:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140118144:12345-0@lo:400:kworker.0 Request processed in 29us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241603.346589:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782241603.346601:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782241603.346607:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140117888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346632:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140117888:12345-0@lo:400:kworker.0 Request processed in 25us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241603.346637:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782241603.346648:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782241603.346654:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140117376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346677:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140117376:12345-0@lo:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241603.346691:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782241603.346719:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782241603.346725:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140118016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346751:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140118016:12345-0@lo:400:kworker.0 Request processed in 27us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241603.346777:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782241603.346795:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140117632 00000100:00100000:0.0:1782241603.346798:0:24124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140117632 00000100:00100000:0.0:1782241603.346824:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782241603.346830:0:24124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140117632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346858:0:24124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140117632:12345-0@lo:400:kworker.0 Request processed in 29us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241603.346864:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1782241603.346893:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241603.346898:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241603.346900:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1782241603.346929:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d48834e00 x1868815140117376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241603.346941:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140117376:0@lo:400:kworker.0 00010000:00080000:0.0:1782241603.346953:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e778df480 x1868815140118016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241603.346961:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140118016:0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.346970:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140116992:0@lo:400:kworker.0 00010000:00080000:0.0:1782241603.346978:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e778df800 x1868815140117888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241603.346993:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140117888:0@lo:400:kworker.0 00010000:00080000:0.0:1782241603.347028:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e778dc700 x1868815140117632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241603.347037:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140117632:0@lo:400:kworker.0 00000100:00100000:0.0:1782241603.347047:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140117504:0@lo:400:kworker.0 00010000:00080000:0.0:1782241603.347056:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e778df100 x1868815140118144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241603.347063:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140118144:0@lo:400:kworker.0 00000100:00100000:1.0:1782241603.347430:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140116864 00000100:00100000:1.0:1782241603.347441:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140116864 00000100:00100000:1.0:1782241603.347479:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782241603.347486:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:3639:x1868815140116864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241603.347531:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:3639:x1868815140116864:12345-0@lo:400:kworker.0 Request processed in 45us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241603.347537:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782241603.347578:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140117120:0@lo:8:kworker.0 00000100:00100000:1.0:1782241603.347605:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241603.347635:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140117248:0@lo:8:kworker.0 00000100:00100000:1.0:1782241603.347658:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241603.347675:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140117760:0@lo:8:kworker.0 00000100:00100000:1.0:1782241603.347694:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241603.347733:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140117120 00000100:00100000:1.0:1782241603.347737:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140117120 00000100:00100000:1.0:1782241603.347780:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140117248 00000100:00100000:1.0:1782241603.347783:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140117248 00000100:00100000:1.0:1782241603.347793:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140117760 00000100:00100000:1.0:1782241603.347795:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140117760 00000100:00100000:1.0:1782241603.347804:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241603.347808:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815140117120:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1782241603.347832:0:24572:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 666 last 0 00000020:00000080:1.0:1782241603.347864:0:24572:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1b3db 00002000:00100000:1.0:1782241603.347877:0:24572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff890e735cb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1782241603.347881:0:24572:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1782241603.347884:0:24572:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782241603.347975:0:24572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782241603.347999:0:24572:0:(import.c:65:import_set_state_nolock()) ffff890e735cc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241603.348045:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1868815140117120:12345-0@lo:8:kworker.0 Request processed in 234us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241603.348052:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241603.348064:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241603.348068:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815140117248:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1782241603.348080:0:24572:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782241603.348104:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815140117248:12345-0@lo:8:kworker.0 Request processed in 34us (445us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782241603.348110:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241603.348120:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782241603.348124:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815140117760:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1782241603.348132:0:24572:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782241603.348153:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815140117760:12345-0@lo:8:kworker.0 Request processed in 27us (458us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782241603.348158:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1782241603.348191:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d48834000 x1868815140117120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241603.348199:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782241603.348205:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1782241603.348213:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782241603.348217:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1782241603.348220:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d47b7a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782241603.348229:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782241603.348234:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140117120:0@lo:8:kworker.0 00000100:00080000:1.0:1782241603.348244:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48885000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241603.348253:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782241603.348256:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140117248:0@lo:8:kworker.0 00000100:00080000:1.0:1782241603.348266:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241603.348269:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782241603.348271:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140117760:0@lo:8:kworker.0 00000100:00100000:1.0:1782241603.348301:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140116864:0@lo:400:kworker.0 00000004:00080000:0.0:1782241603.349039:0:22636:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1782241603.349058:0:22636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22636:1868815140118400:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1782241603.349094:0:22636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241603.349111:0:22636:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4898cc00 going to sleep for 11 seconds 00000004:00080000:0.0:1782241603.349127:0:22635:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782241603.349203:0:22635:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 666607445378ns, next at 0ns, rc = 0 00080000:00080000:0.0:1782241603.349210:0:22635:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1782241603.349490:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140118272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241603.349530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241603.349574:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140118400 00000100:00100000:1.0:1782241603.349579:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140118400 00000100:00100000:1.0:1782241603.349617:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241603.349626:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22636:x1868815140118400:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1782241603.351116:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140118272 00000100:00100000:0.0:1782241603.351126:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140118272 00000100:00100000:0.0:1782241603.351166:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782241603.351174:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1868815140118272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241603.351200:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1782241603.351274:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1868815140118272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241603.351281:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1782241603.351332:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782241603.351364:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676d880 x1868815140118272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241603.351383:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140118272:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1782241603.355814:0:22592:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1782241603.362259:0:24572:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1782241603.362282:0:24572:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1782241603.362293:0:24572:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:3.0:1782241603.375032:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.375050:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b3e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.375068:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.375073:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.375080:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.375100:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.375110:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.375118:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.375143:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241603.375269:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.375284:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.375301:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.375308:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.375322:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.375373:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b3e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.375382:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b3e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.375416:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.375419:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.375421:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241603.376288:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.376305:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b3e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.376319:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.376323:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.376329:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.376340:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.376348:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.376355:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.376386:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241603.376722:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.376730:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.376739:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.376744:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.376783:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.376802:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b3e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.376808:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b3e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.376836:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.376838:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.376840:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241603.384112:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241603.384129:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b3f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.384148:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1782241603.384152:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241603.384159:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.384176:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.384187:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.384195:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.384214:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241603.384226:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.384232:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.384253:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.384258:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.384268:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b3f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.384286:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b3f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.384293:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b3f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.384311:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.384313:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.384315:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241603.385443:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241603.385452:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b3f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.385464:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1782241603.385467:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241603.385473:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.385484:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.385501:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.385523:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.385540:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241603.385549:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.385553:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.385560:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.385564:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.385573:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.385586:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b3f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.385592:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b3f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.385608:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.385615:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.385617:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241603.386110:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241603.386416:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b3fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.386435:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1782241603.386439:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241603.386446:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b3fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.386472:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b3fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.386483:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b3fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.386491:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b3fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.386514:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241603.386539:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.386546:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b3fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.386554:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.386559:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b3fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.386589:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b3fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.386875:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b3fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.387043:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b3fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.387066:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.387068:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.387070:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241603.390930:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241603.392035:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b405 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.392060:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1782241603.392065:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241603.392072:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b405 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.392091:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b405 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.392103:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b405 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.392196:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b405 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.392228:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241603.392250:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.392328:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b405 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.392339:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.392408:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b405 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.392420:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.392442:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b405 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.393429:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b405 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.393471:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.393473:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.393476:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241603.394666:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241603.395053:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d499fe87/0xc9959f2fb1e1b40c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.395073:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1782241603.395078:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241603.395086:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d499fe87/0xc9959f2fb1e1b40c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.395103:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d499fe87/0xc9959f2fb1e1b40c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.395115:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d499fe87/0xc9959f2fb1e1b40c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.395189:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d499fe87/0xc9959f2fb1e1b40c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.395547:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241603.395624:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241603.395639:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d499fe87/0xc9959f2fb1e1b40c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.395654:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311a00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241603.395659:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d499fe87/0xc9959f2fb1e1b40c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.395671:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d499fe87/0xc9959f2fb1e1b40c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.395718:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d499fe87/0xc9959f2fb1e1b40c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.395726:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d499fe87/0xc9959f2fb1e1b40c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.395750:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241603.395752:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241603.395793:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241603.397783:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241603.397797:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b413 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.397813:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=666s v=(0 0) 00010000:00010000:2.0:1782241603.397818:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241603.397826:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b413 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.397839:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b413 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.397860:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b413 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.397868:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b413 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.397916:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241603.398063:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.398078:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b413 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.398093:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.398100:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b413 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.398113:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b413 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.398168:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b413 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.398178:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b413 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.398207:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.398210:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.398213:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241603.402100:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241603.402121:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b41a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.402152:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1782241603.402158:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241603.402167:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b41a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.402186:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b41a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.402199:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b41a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.402207:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b41a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.402269:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241603.404031:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241603.404045:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b41a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.404059:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241603.404064:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b41a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.404088:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b41a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.404112:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b41a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.404130:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c21b6bc5/0xc9959f2fb1e1b41a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.404154:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241603.404156:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241603.404158:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241603.404536:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241603.404550:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b421 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.404567:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1782241603.404571:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241603.404578:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b421 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.404592:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b421 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.405041:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b421 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.405051:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b421 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.405078:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241603.405855:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241603.405868:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b421 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.405881:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241603.405896:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b421 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.405907:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b421 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.405926:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b421 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.405933:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ce3bd92/0xc9959f2fb1e1b421 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.405953:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241603.405955:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241603.405957:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241603.406839:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241603.406853:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b428 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.406871:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1782241603.407870:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241603.407992:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.408017:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.408031:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.408040:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b428 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.408304:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241603.408330:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.408337:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b428 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.408513:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.408519:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b428 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.408530:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b428 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.408554:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b428 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.408579:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b428 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.408613:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.408615:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.408617:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241603.421053:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241603.421068:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b42f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.421085:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=666s v=(0 0) 00010000:00010000:2.0:1782241603.421089:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241603.421095:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b42f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.421109:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b42f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.421120:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b42f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.421136:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b42f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.421161:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241603.421173:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241603.421179:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b42f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.421187:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43faca00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241603.421192:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b42f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.421201:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b42f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.421217:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b42f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.421225:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b42f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241603.421243:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241603.421245:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241603.421247:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241603.425753:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.425790:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1b436 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.425810:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.425816:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.425823:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1b436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.425841:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1b436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.425860:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1b436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.425869:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1b436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.425891:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782241603.426709:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.426720:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b43d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.426732:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.426736:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.426742:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b43d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.426752:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b43d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.426781:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b43d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.426789:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b43d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.426832:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782241603.426854:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241603.426870:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1b436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.426886:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.426894:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1b436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.426906:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1b436 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.426933:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1b436 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.426941:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1b436 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.426967:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.426971:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b43d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.426993:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.426997:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b43d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.427006:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b43d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.427018:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b43d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.427026:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e1b43d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.427042:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.427045:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.427047:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241603.427746:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.427754:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b444 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.427829:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.427833:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.427837:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.427850:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.427859:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.427865:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b444 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.427929:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782241603.428716:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.428724:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a31b7d8/0xc9959f2fb1e1b44b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.428734:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.428745:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.428750:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a31b7d8/0xc9959f2fb1e1b44b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.428793:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a31b7d8/0xc9959f2fb1e1b44b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.428802:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a31b7d8/0xc9959f2fb1e1b44b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.428809:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a31b7d8/0xc9959f2fb1e1b44b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.428831:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782241603.428851:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241603.428864:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b444 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.428877:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.428882:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b444 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.428896:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b444 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.428932:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b444 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.428941:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e95febcd/0xc9959f2fb1e1b444 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.428966:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.428970:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a31b7d8/0xc9959f2fb1e1b44b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.428978:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eac00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241603.428980:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.428983:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a31b7d8/0xc9959f2fb1e1b44b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.428996:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a31b7d8/0xc9959f2fb1e1b44b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.429009:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a31b7d8/0xc9959f2fb1e1b44b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.429016:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a31b7d8/0xc9959f2fb1e1b44b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.429034:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.429037:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.429047:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241603.429730:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241603.430394:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.430403:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001390e451/0xc9959f2fb1e1b452 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.430418:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.430422:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.430429:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001390e451/0xc9959f2fb1e1b452 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.430443:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001390e451/0xc9959f2fb1e1b452 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.430453:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001390e451/0xc9959f2fb1e1b452 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.430469:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001390e451/0xc9959f2fb1e1b452 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.430486:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782241603.431887:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.431898:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2380bd3/0xc9959f2fb1e1b459 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.431913:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.431917:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.431921:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2380bd3/0xc9959f2fb1e1b459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.431933:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2380bd3/0xc9959f2fb1e1b459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.431942:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2380bd3/0xc9959f2fb1e1b459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.431951:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2380bd3/0xc9959f2fb1e1b459 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.431975:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782241603.431992:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241603.432007:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001390e451/0xc9959f2fb1e1b452 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.432020:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.432026:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001390e451/0xc9959f2fb1e1b452 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.432038:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001390e451/0xc9959f2fb1e1b452 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.432421:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001390e451/0xc9959f2fb1e1b452 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.432434:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001390e451/0xc9959f2fb1e1b452 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.432463:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.432468:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2380bd3/0xc9959f2fb1e1b459 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.432476:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebc00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.432480:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2380bd3/0xc9959f2fb1e1b459 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.432488:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2380bd3/0xc9959f2fb1e1b459 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.432517:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2380bd3/0xc9959f2fb1e1b459 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.432525:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2380bd3/0xc9959f2fb1e1b459 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.432542:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.432544:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.432546:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241603.432659:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.432668:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1b460 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.432688:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.432691:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.432708:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1b460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.432719:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1b460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.432727:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1b460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.432735:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1b460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.432893:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782241603.433663:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.433672:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007182473f/0xc9959f2fb1e1b467 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.433684:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.433688:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.433693:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007182473f/0xc9959f2fb1e1b467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.433715:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007182473f/0xc9959f2fb1e1b467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.433736:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007182473f/0xc9959f2fb1e1b467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.433743:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007182473f/0xc9959f2fb1e1b467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.433790:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782241603.433968:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241603.433980:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1b460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.433993:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebe00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.433998:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1b460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.434009:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1b460 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.434028:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1b460 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.434036:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1b460 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.434371:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.434376:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007182473f/0xc9959f2fb1e1b467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.434386:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.434390:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007182473f/0xc9959f2fb1e1b467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.434398:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007182473f/0xc9959f2fb1e1b467 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.434411:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007182473f/0xc9959f2fb1e1b467 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.434419:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007182473f/0xc9959f2fb1e1b467 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.434434:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.434436:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.434438:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241603.434598:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241603.434610:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241603.434917:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.434928:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001de6901a/0xc9959f2fb1e1b46e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.434941:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.434945:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.434950:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001de6901a/0xc9959f2fb1e1b46e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.434962:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001de6901a/0xc9959f2fb1e1b46e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.434971:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001de6901a/0xc9959f2fb1e1b46e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.434979:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001de6901a/0xc9959f2fb1e1b46e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.435019:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241603.435032:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241603.435042:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001de6901a/0xc9959f2fb1e1b46e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.435051:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241603.435064:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001de6901a/0xc9959f2fb1e1b46e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.435404:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001de6901a/0xc9959f2fb1e1b46e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.435422:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001de6901a/0xc9959f2fb1e1b46e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.435429:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001de6901a/0xc9959f2fb1e1b46e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241603.435450:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.435452:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241603.435454:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241603.436719:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241603.436729:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b475 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.436743:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=666s v=(0 0) 00010000:00010000:0.0:1782241603.436748:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241603.437576:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.437599:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.437610:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.437617:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.437679:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241603.437949:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241603.437956:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.437964:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ac00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241603.437969:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.437978:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b475 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.437996:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b475 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.438003:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b475 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.438019:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.438021:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.438023:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241603.438251:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241603.438258:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b47c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.438278:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=666s v=(0 0) 00010000:00010000:0.0:1782241603.438282:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241603.438288:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.438298:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.438307:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.438313:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b47c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.438366:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782241603.438743:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241603.438750:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b483 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.438797:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=666s v=(0 0) 00010000:00010000:0.0:1782241603.438800:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241603.438805:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.438815:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.438836:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.438844:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.438891:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241603.438898:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b47c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.438907:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ba00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241603.438918:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b47c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.438927:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b47c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.438941:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b47c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.438948:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b47c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.438971:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241603.438974:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b483 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.438981:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499be00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241603.438986:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b483 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.438993:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b483 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.439005:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b483 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.439014:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.439023:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.439027:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241603.439097:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782241603.439102:0:24572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b483 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.439313:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241603.439575:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241603.439581:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b48a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.439590:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=666s v=(0 0) 00010000:00010000:0.0:1782241603.439593:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241603.439596:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b48a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.439605:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b48a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.439613:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b48a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.439629:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b48a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.439648:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241603.439838:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241603.439843:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b48a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.439850:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241603.439854:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b48a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.439862:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b48a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.439876:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b48a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.439883:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b48a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.439898:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.439900:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.439901:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241603.440130:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241603.440135:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b491 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.440144:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=666s v=(0 0) 00010000:00010000:0.0:1782241603.440146:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241603.440151:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.440160:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.440167:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.440173:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.440193:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241603.440304:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241603.440310:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.440319:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241603.440330:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.440341:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b491 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.440353:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b491 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.440360:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b491 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.440378:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.440380:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.440384:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241603.440884:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.440891:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b498 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.440900:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.440904:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.440909:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.440923:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.440931:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.440945:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b498 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.441000:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241603.441149:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241603.441155:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b498 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.441169:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241603.441173:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b498 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.441182:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b498 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.441194:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b498 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.441202:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b498 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.441219:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241603.441221:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241603.441223:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241603.441833:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241603.441840:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b49f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.441850:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1782241603.441853:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241603.441858:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b49f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.441867:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b49f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.441875:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b49f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.441882:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b49f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.441899:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241603.442065:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241603.442071:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b49f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442079:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241603.442084:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b49f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442091:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b49f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442110:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b49f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442117:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b49f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442133:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241603.442134:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241603.442136:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241603.442263:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241603.442268:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b4a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442276:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=666s v=(0 0) 00010000:00010000:0.0:1782241603.442279:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241603.442284:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442294:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442301:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442307:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b4a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442369:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782241603.442832:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241603.442838:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442846:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=666s v=(0 0) 00010000:00010000:0.0:1782241603.442849:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241603.442853:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442862:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442869:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.442883:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.443017:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241603.443024:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b4a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.443037:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241603.443041:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b4a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.443050:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b4a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.443062:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b4a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.443069:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b4a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.443083:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241603.443086:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.443092:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499aa00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241603.443095:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.443102:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.443111:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.443124:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.443126:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.443128:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241603.443215:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782241603.443220:0:24572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.443355:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241603.453037:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241603.453057:0:24572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.454367:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=666s v=(0 0) 00010000:00010000:0.0:1782241603.454373:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241603.454383:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.454402:0:24572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.454416:0:24572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.454425:0:24572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241603.454451:0:24572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1782241603.454577:0:24572:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:0.0:1782241603.454713:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22636:x1868815140118400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 105083us (105613us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241603.454725:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1782241603.454879:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241603.454888:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.454900:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499aa00 already unused, calling callback (ffffffffc0cc6ce0) 00000100:00100000:2.0:1782241603.454904:0:22636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22636:1868815140118400:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1782241603.454908:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.454926:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782241603.454931:0:22636:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00010000:00010000:3.0:1782241603.454950:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241603.454961:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1b4b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241603.454988:0:22636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fce300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22636:1868815140118528:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1782241603.454989:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.454993:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241603.454997:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241603.455056:0:22636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241603.455098:0:22636:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4809c900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241603.455342:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140118528 00000100:00100000:0.0:1782241603.455354:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140118528 00000100:00100000:0.0:1782241603.455420:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782241603.455432:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22636:x1868815140118528:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1782241603.455493:0:24125:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:0.0:1782241603.472442:0:24119:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1782241603.472523:0:24119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1782241603.472854:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22636:x1868815140118528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17417us (17791us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1782241603.472869:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782241603.472983:0:22636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1782241603.472995:0:22636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fce300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22636:1868815140118528:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1782241603.473015:0:22636:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1782241604.356968:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241605.381895:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782241605.495729:0:24939:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782241605.495733:0:24939:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1782241605.495734:0:24939:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1782241605.500510:0:24939:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff890e735c9000 00000020:01000004:1.0:1782241605.500533:0:24939:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1782241605.500549:0:24939:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782241605.500563:0:24939:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff890d47700000) 00000020:00000080:1.0:1782241605.500581:0:24939:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1782241605.556634:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1782241605.558413:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1782241605.558667:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1782241605.559133:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1782241605.559436:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1782241605.559627:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1782241605.559972:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1782241605.562568:0:24939:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782241605.562942:0:24939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1782241605.562957:0:24939:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782241605.562969:0:24939:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc9959f2fb1e1b4c2 00000020:01000004:2.0:1782241605.562976:0:24939:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1782241605.562998:0:24939:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782241605.563002:0:24939:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782241605.563008:0:24939:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1782241605.563038:0:24939:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1782241605.563048:0:24939:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1782241605.575057:0:24939:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782241605.575103:0:24939:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.158@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1782241605.575107:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782241605.575109:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782241605.575110:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241605.575111:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241605.575112:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241605.575114:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241605.575115:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241605.575116:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241605.575118:0:24939:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782241605.575121:0:24939:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1782241605.575123:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782241605.575124:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782241605.575125:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241605.575126:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241605.575127:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241605.575128:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241605.575128:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241605.575129:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241605.575130:0:24939:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782241605.575156:0:24939:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782241605.575177:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140118656:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782241605.575250:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241605.575306:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241605.575372:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140118656 00000100:00100000:3.0:1782241605.575379:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140118656 00000100:00100000:3.0:1782241605.575436:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782241605.575447:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24939:x1868815140118656:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782241605.575477:0:22606:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1782241605.575480:0:22606:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1782241605.575483:0:22606:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1782241605.575922:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24939:x1868815140118656:12345-0@lo:253:mount.lustre.0 Request processed in 475us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241605.575930:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782241605.576132:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140118656:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782241605.576143:0:24939:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782241605.576145:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782241605.576146:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782241605.576148:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241605.576148:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241605.576150:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241605.576151:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241605.576152:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241605.576153:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241605.576162:0:24939:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782241605.576184:0:24939:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890e735c9000 from lustre-OST0001 10000000:01000000:2.0:1782241605.576209:0:24939:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1782241605.576211:0:24939:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782241605.576219:0:24939:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff890e77d999c0 local copy 00010000:00010000:2.0:1782241605.576229:0:24939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241605.576420:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140118784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241605.576450:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241605.576520:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce469c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241605.576625:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140118784 00000100:00100000:0.0:1782241605.576631:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140118784 00000100:00100000:0.0:1782241605.576708:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782241605.576717:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24939:x1868815140118784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241605.576940:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140118784:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1782241605.576953:0:24939:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782241605.576971:0:24939:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782241605.576977:0:24939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241605.576985:0:24939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e1b0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b103 expref: -99 pid: 22591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241605.577009:0:24939:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890e735c9000 10000000:01000000:2.0:1782241605.577014:0:24939:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782241605.577019:0:24939:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782241605.577021:0:24939:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782241605.577025:0:24939:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1782241605.577027:0:24939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782241605.577047:0:24939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fad000/0xc9959f2fb1e1b4c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241605.577055:0:24939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e43fad000/0xc9959f2fb1e1b4c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241605.577070:0:24939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e43fad000/0xc9959f2fb1e1b4c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241605.577082:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140118912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782241605.577111:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.577127:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24939:x1868815140118784:12345-0@lo:501:mount.lustre.0 Request processed in 115us (380us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782241605.577137:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782241605.577301:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce469c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241605.577453:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140118912 00000100:00100000:0.0:1782241605.577458:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140118912 00000100:00100000:0.0:1782241605.577478:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782241605.577484:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:24939:x1868815140118912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241605.577493:0:22605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241605.577505:0:22605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b4d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b4c9 expref: -99 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.577525:0:22605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b4c9 expref: 22 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.577534:0:22605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4499be00/0xc9959f2fb1e1b4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b4c9 expref: 22 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.577543:0:22605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499be00, rc 0) 00000100:00100000:0.0:1782241605.577580:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24939:x1868815140118912:12345-0@lo:101:mount.lustre.0 Request processed in 96us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.577595:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782241605.577718:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140118912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241605.577731:0:24939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e43fad000/0xc9959f2fb1e1b4c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b4d0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241605.577739:0:24939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e43fad000/0xc9959f2fb1e1b4c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b4d0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782241605.579500:0:24939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1782241605.580219:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241605.582644:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1782241605.582708:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1782241605.582726:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1782241605.582739:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1782241605.582752:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1782241605.583015:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1782241605.583030:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1782241605.583044:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1782241605.583057:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1782241605.583083:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1782241605.583089:0:24939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1782241605.583202:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241605.583272:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241605.583335:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e8215b600 going to sleep for 11 seconds 00000100:00100000:1.0:1782241605.583529:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140119040 00000100:00100000:1.0:1782241605.583537:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140119040 00000100:00100000:1.0:1782241605.583590:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782241605.583601:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24939:x1868815140119040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241605.583791:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24939:x1868815140119040:12345-0@lo:501:mount.lustre.0 Request processed in 191us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241605.583824:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782241605.584115:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241605.584154:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241605.584199:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241605.584233:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e8215b600 going to sleep for 11 seconds 00000100:00100000:2.0:1782241605.584299:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140119168 00000100:00100000:2.0:1782241605.584305:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140119168 00000100:00100000:2.0:1782241605.584341:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782241605.584349:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24939:x1868815140119168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782241605.585255:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24939:x1868815140119168:12345-0@lo:503:mount.lustre.0 Request processed in 903us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241605.585265:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782241605.585426:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119168:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782241605.585972:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782241605.586049:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241605.586100:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241605.586142:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4809cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241605.586213:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140119296 00000100:00100000:1.0:1782241605.586220:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140119296 00000100:00100000:1.0:1782241605.586257:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782241605.586266:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24939:x1868815140119296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241605.586703:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24939:x1868815140119296:12345-0@lo:502:mount.lustre.0 Request processed in 435us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241605.586711:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782241605.587045:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241605.587261:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1782241605.587308:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1782241605.587324:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1782241605.587340:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1782241605.587352:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1782241605.587366:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1782241605.587384:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1782241605.587397:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1782241605.587408:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1782241605.587432:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241605.587475:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241605.587512:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4809cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241605.587622:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140119424 00000100:00100000:2.0:1782241605.587627:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140119424 00000100:00100000:2.0:1782241605.587674:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782241605.587683:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24939:x1868815140119424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241605.587826:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24939:x1868815140119424:12345-0@lo:502:mount.lustre.0 Request processed in 143us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241605.587900:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782241605.588035:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241605.588078:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1782241605.588088:0:24939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1782241605.589542:0:24943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782241605.589552:0:24943:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1782241605.589559:0:24943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241605.589561:0:24943:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1782241605.589567:0:24943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782241605.589581:0:24943:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff890e43feb380) 00000020:00000080:3.0:1782241605.589606:0:24943:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782241605.589623:0:24943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782241605.589707:0:24943:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e735c9000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1782241605.589715:0:24943:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782241605.589722:0:24943:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc9959f2fb1e1b4de 00010000:00010000:3.0:1782241605.594550:0:24943:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1782241605.595224:0:24943:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1782241605.599725:0:24943:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1782241605.601097:0:24943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1782241605.601108:0:24943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241605.601114:0:24943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241605.601117:0:24943:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1782241605.601120:0:24943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241605.601123:0:24943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241605.601124:0:24943:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782241605.601127:0:24943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782241605.601130:0:24943:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782241605.601132:0:24943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241605.601133:0:24943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241605.601135:0:24943:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1782241605.601136:0:24943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241605.601138:0:24943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241605.601139:0:24943:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782241605.601142:0:24943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1782241605.601167:0:24943:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241605.601169:0:24943:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241605.601170:0:24943:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782241605.601173:0:24943:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1782241605.601229:0:24939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1782241605.601263:0:24939:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782241605.601295:0:24939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fad000/0xc9959f2fb1e1b4c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b4d0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241605.601307:0:24939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e43fad000/0xc9959f2fb1e1b4c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b4d0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241605.601321:0:24939:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e735c9000 from 1 10000000:01000000:3.0:1782241605.601323:0:24939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241605.601359:0:24939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241605.601367:0:24939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241605.601378:0:24939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241605.601399:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782241605.601467:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241605.601504:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4898cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241605.603016:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140119552 00000100:00100000:3.0:1782241605.603027:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140119552 00000100:00100000:3.0:1782241605.603074:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782241605.603082:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:24939:x1868815140119552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241605.603098:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241605.603112:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1b4ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b4e5 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241605.603137:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1b4ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b4e5 expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241605.603148:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1b4ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b4e5 expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241605.603169:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea800, rc 0) 00000100:00100000:3.0:1782241605.603243:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:24939:x1868815140119552:12345-0@lo:101:mount.lustre.0 Request processed in 161us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241605.603251:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782241605.604176:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241605.604200:0:24939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241605.604211:0:24939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782241605.607035:0:24939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1782241605.608244:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241605.608563:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1782241605.608591:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1782241605.608606:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1782241605.608619:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1782241605.608632:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1782241605.608647:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1782241605.608674:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1782241605.608689:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1782241605.608701:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1782241605.608714:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1782241605.608750:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1782241605.608825:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1782241605.610005:0:24939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1782241605.610119:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241605.610192:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241605.610288:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241605.614035:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140119680 00000100:00100000:0.0:1782241605.614050:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140119680 00000100:00100000:1.0:1782241605.615186:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782241605.615198:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:24939:x1868815140119680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241605.615388:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:24939:x1868815140119680:12345-0@lo:501:mount.lustre.0 Request processed in 190us (5193us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241605.615396:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782241605.615563:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241605.615623:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241605.615689:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241605.615730:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4898c000 going to sleep for 11 seconds 00000100:00100000:0.0:1782241605.615807:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140119808 00000100:00100000:0.0:1782241605.615814:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140119808 00000100:00100000:0.0:1782241605.615859:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782241605.615867:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:24939:x1868815140119808:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241605.615954:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:24939:x1868815140119808:12345-0@lo:503:mount.lustre.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.615961:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782241605.616013:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782241605.616713:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241605.616952:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241605.617006:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.617077:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869540 going to sleep for 11 seconds 00000100:00100000:3.0:1782241605.617225:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140119936 00000100:00100000:3.0:1782241605.617231:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140119936 00000100:00100000:3.0:1782241605.617309:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782241605.617319:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:24939:x1868815140119936:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241605.617418:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:24939:x1868815140119936:12345-0@lo:502:mount.lustre.0 Request processed in 101us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241605.617426:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782241605.617570:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140119936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782241605.617867:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1782241605.617897:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1782241605.617912:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1782241605.617925:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1782241605.617936:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1782241605.617948:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1782241605.617959:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1782241605.617972:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1782241605.617986:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1782241605.617999:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1782241605.618012:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1782241605.618047:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241605.618088:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.618114:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869540 going to sleep for 11 seconds 00000100:00100000:0.0:1782241605.618129:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140120064 00000100:00100000:0.0:1782241605.618133:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140120064 00000100:00100000:0.0:1782241605.618155:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782241605.618161:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:24939:x1868815140120064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241605.618248:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:24939:x1868815140120064:12345-0@lo:502:mount.lustre.0 Request processed in 87us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.618256:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782241605.618439:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782241605.618480:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1782241605.618489:0:24939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1782241605.619498:0:24947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241605.619509:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241605.619512:0:24947:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782241605.619520:0:24947:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e735c9000 00000020:00000080:1.0:1782241605.619523:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241605.619530:0:24947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241605.619533:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241605.619534:0:24947:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782241605.619537:0:24947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241605.619539:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241605.619541:0:24947:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782241605.619545:0:24947:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e735c9000 00000020:00000080:1.0:1782241605.619547:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241605.619611:0:24947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241605.619615:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241605.619616:0:24947:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782241605.619619:0:24947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241605.619621:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241605.619622:0:24947:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782241605.619626:0:24947:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e735c9000 00000020:00000080:1.0:1782241605.619628:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241605.619667:0:24947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241605.619671:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241605.619672:0:24947:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782241605.619675:0:24947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241605.619678:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241605.619679:0:24947:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1782241605.619683:0:24947:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e735c9000 00000020:00000080:1.0:1782241605.619685:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241605.619709:0:24947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241605.619711:0:24947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241605.619713:0:24947:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1782241605.619716:0:24947:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1782241605.620017:0:24939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1782241605.620040:0:24939:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782241605.620062:0:24939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.620073:0:24939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241605.620125:0:24939:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782241605.620129:0:24939:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890e735c9000 10000000:01000000:0.0:1782241605.620132:0:24939:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890e735c9000 10000000:01000000:0.0:1782241605.620136:0:24939:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782241605.620141:0:24939:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e735c9000 from 1 10000000:01000000:0.0:1782241605.620143:0:24939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782241605.620177:0:24939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b4f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.620192:0:24939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b4f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.620203:0:24939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b4f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241605.620224:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782241605.620401:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.620468:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d468693c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241605.624940:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140120192 00000100:00100000:1.0:1782241605.624956:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140120192 00000100:00100000:1.0:1782241605.625015:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782241605.625026:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:24939:x1868815140120192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241605.625042:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241605.625060:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e7c310000/0xc9959f2fb1e1b4fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b4f3 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241605.625087:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c310000/0xc9959f2fb1e1b4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b4f3 expref: 24 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241605.625096:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e7c310000/0xc9959f2fb1e1b4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b4f3 expref: 24 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241605.625104:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c310000, rc 0) 00000100:00100000:1.0:1782241605.625173:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140120192:12345-0@lo:101:mount.lustre.0 Request processed in 149us (4772us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241605.625180:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782241605.625243:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241605.625270:0:24939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b4f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b4fa expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241605.625294:0:24939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b4f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b4fa expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782241605.634436:0:24939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1782241605.634782:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241605.635034:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1782241605.635060:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1782241605.635088:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1782241605.635104:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1782241605.635118:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1782241605.635131:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1782241605.635143:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1782241605.635155:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1782241605.635167:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1782241605.635180:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1782241605.635192:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1782241605.635204:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1782241605.635216:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1782241605.635227:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1782241605.635239:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1782241605.635250:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1782241605.635262:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1782241605.635273:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1782241605.636056:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1782241605.636077:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1782241605.636090:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1782241605.636103:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1782241605.636116:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1782241605.636130:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1782241605.636144:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1782241605.636156:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1782241605.636177:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1782241605.636188:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1782241605.636198:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1782241605.636209:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1782241605.636220:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1782241605.636231:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1782241605.636242:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1782241605.636253:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1782241605.637380:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1782241605.637429:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1782241605.637446:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1782241605.637461:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1782241605.637476:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1782241605.637492:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1782241605.637506:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1782241605.637521:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1782241605.637535:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1782241605.637549:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1782241605.637562:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1782241605.637574:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1782241605.637588:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1782241605.637601:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1782241605.639007:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1782241605.639052:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1782241605.639074:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1782241605.639080:0:24939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1782241605.639192:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241605.639260:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241605.639318:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241605.640395:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140120320 00000100:00100000:0.0:1782241605.640404:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140120320 00000100:00100000:0.0:1782241605.640465:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782241605.640475:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140120320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241605.640631:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140120320:12345-0@lo:501:mount.lustre.0 Request processed in 157us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.640638:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782241605.644784:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241605.644843:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782241605.644927:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241605.644960:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241605.644983:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140120448 00000100:00100000:2.0:1782241605.644990:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140120448 00000100:00100000:2.0:1782241605.645040:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782241605.645050:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140120448:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782241605.645179:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140120448:12345-0@lo:503:mount.lustre.0 Request processed in 129us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241605.645186:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782241605.645205:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120448:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782241605.647206:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782241605.647438:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241605.647514:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241605.649095:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d87180 going to sleep for 11 seconds 00000100:00100000:2.0:1782241605.651994:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140120576 00000100:00100000:2.0:1782241605.652009:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140120576 00000100:00100000:2.0:1782241605.653155:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782241605.653172:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140120576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241605.653369:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140120576:12345-0@lo:502:mount.lustre.0 Request processed in 201us (5854us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241605.653377:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782241605.657287:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241605.657523:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1782241605.657557:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1782241605.657583:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1782241605.657597:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1782241605.657609:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1782241605.657622:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1782241605.657636:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1782241605.657650:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1782241605.657686:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1782241605.657699:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1782241605.657713:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1782241605.657726:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1782241605.657738:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1782241605.657791:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1782241605.658106:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1782241605.658123:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1782241605.658136:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1782241605.658149:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1782241605.658161:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1782241605.658172:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1782241605.658185:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1782241605.658198:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1782241605.658211:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1782241605.658224:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1782241605.658237:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1782241605.658249:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1782241605.658261:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1782241605.659012:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1782241605.659050:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1782241605.659080:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1782241605.659097:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1782241605.659112:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1782241605.659125:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1782241605.659137:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1782241605.659147:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1782241605.659172:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1782241605.659185:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1782241605.659198:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1782241605.659211:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1782241605.659221:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1782241605.659232:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1782241605.659243:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1782241605.659253:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1782241605.659266:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1782241605.660035:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1782241605.660082:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1782241605.660099:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1782241605.660113:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1782241605.660171:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241605.660251:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241605.661083:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140120704 00000100:00100000:2.0:1782241605.661092:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140120704 00000100:00100000:2.0:1782241605.661143:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782241605.661152:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140120704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241605.661273:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140120704:12345-0@lo:502:mount.lustre.0 Request processed in 120us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241605.661358:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782241605.662125:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4145f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241605.662157:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241605.663485:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1782241605.663532:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1782241605.663578:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241605.664176:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241605.664256:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d87180 going to sleep for 11 seconds 00000100:00100000:2.0:1782241605.666796:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140120832 00000100:00100000:2.0:1782241605.666992:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140120832 00000100:00100000:3.0:1782241605.667161:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782241605.667172:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140120832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241605.668477:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140120832:12345-0@lo:502:mount.lustre.0 Request processed in 1300us (4818us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241605.668491:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782241605.669092:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140120832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782241605.669206:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1782241605.669220:0:24939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1782241605.674115:0:24953:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1782241605.674152:0:24953:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff890d45bc99c0) 00000020:00000080:2.0:1782241605.674179:0:24953:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1782241605.674466:0:24953:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e735c9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1782241605.674471:0:24953:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e735c9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1782241605.674473:0:24953:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e735c9000 3 00010000:00080000:2.0:1782241605.674505:0:24953:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d47a66800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.158@tcp at head 00010000:00010000:2.0:1782241605.683365:0:24953:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1782241605.683490:0:24953:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1782241605.683542:0:24953:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782241605.683556:0:24953:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc9959f2fb1e1b508 00000100:00080000:2.0:1782241605.683566:0:24953:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782241605.683572:0:24953:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff890d47a66800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241605.683609:0:24953:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e77fcd880 x1868815140120960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782241605.684079:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140120960:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782241605.684154:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.684190:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140120960 00000100:00100000:0.0:1782241605.684197:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140120960 00000100:00100000:0.0:1782241605.684231:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782241605.684239:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140120960:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1782241605.684262:0:22611:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:0.0:1782241605.684295:0:22611:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc9959f2fb1e1b50f 00000004:00100000:0.0:1782241605.684312:0:22611:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782241605.684343:0:22611:0:(import.c:65:import_set_state_nolock()) ffff890d46929800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1782241605.684996:0:24953:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782241605.689190:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1868815140120960:12345-0@lo:38:llog_process_th.0 Request processed in 4940us (5026us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.689225:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1782241605.689338:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241605.689342:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782241605.689346:0:36:0:(import.c:65:import_set_state_nolock()) ffff890d48885000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241605.689351:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:0.0:1782241605.689355:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1782241605.689359:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff890d48885000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241605.689379:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4676df80 x1868815140121344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241605.689420:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241605.689423:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782241605.689425:0:36:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241605.689429:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:0.0:1782241605.689431:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1782241605.689434:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890e449fb000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241605.689443:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4676e300 x1868815140121856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241605.689483:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140121216:0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.689539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.689563:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140121984:0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.689586:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.689605:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782241605.689610:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140121088:0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.689633:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.689670:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140121728:0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.689692:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.689716:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140121600:0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.689737:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.689751:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140122240:0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.689790:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.689805:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782241605.689810:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140121472:0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.689829:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.689842:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140122112:0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.689862:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.689885:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140121984 00000100:00100000:0.0:1782241605.689892:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140121984 00000100:00100000:0.0:1782241605.689926:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140122240 00000100:00100000:0.0:1782241605.689929:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140122240 00000100:00100000:0.0:1782241605.689949:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140121472 00000100:00100000:0.0:1782241605.689951:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140121472 00000100:00100000:0.0:1782241605.689963:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140122112 00000100:00100000:0.0:1782241605.689965:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140122112 00000100:00100000:0.0:1782241605.689979:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782241605.689986:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140121984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.690207:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140121984:12345-0@lo:400:kworker.0 Request processed in 219us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.690214:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782241605.690229:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782241605.690236:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140122240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.690268:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140122240:12345-0@lo:400:kworker.0 Request processed in 34us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.690281:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782241605.690295:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782241605.690300:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140121472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.690330:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140121472:12345-0@lo:400:kworker.0 Request processed in 30us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.690336:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782241605.690347:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782241605.690352:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140122112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.690378:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140122112:12345-0@lo:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.690383:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782241605.690401:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140121088 00000100:00100000:0.0:1782241605.690404:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140121088 00000100:00100000:0.0:1782241605.690426:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140121600 00000100:00100000:0.0:1782241605.690429:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140121600 00000100:00100000:0.0:1782241605.690440:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782241605.690445:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140121088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.690491:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140121088:12345-0@lo:400:kworker.0 Request processed in 44us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.690497:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782241605.690509:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782241605.690515:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140121600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.690540:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140121600:12345-0@lo:400:kworker.0 Request processed in 25us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.690545:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782241605.690570:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140121216 00000100:00100000:0.0:1782241605.690574:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140121216 00000100:00100000:0.0:1782241605.690604:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140121728 00000100:00100000:0.0:1782241605.690607:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140121728 00000100:00100000:0.0:1782241605.690628:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782241605.690633:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140121216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.690676:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140121216:12345-0@lo:400:kworker.0 Request processed in 43us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.690682:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782241605.690693:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782241605.690699:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140121728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241605.690726:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140121728:12345-0@lo:400:kworker.0 Request processed in 27us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.690732:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782241605.693709:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e77fcd880 x1868815140120960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241605.693726:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782241605.693737:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1782241605.693746:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782241605.693752:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782241605.693778:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d47a66800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782241605.693787:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140120960:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782241605.696399:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140121344:0@lo:8:kworker.0 00000100:00100000:1.0:1782241605.696472:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241605.696516:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140121344 00000100:00100000:1.0:1782241605.696522:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140121344 00000100:00100000:1.0:1782241605.696555:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241605.696563:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815140121344:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1782241605.696637:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815140121344:12345-0@lo:8:kworker.0 Request processed in 73us (163us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782241605.696645:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241605.696696:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782241605.696710:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48885000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241605.696714:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782241605.696718:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140121344:0@lo:8:kworker.0 00000100:00100000:1.0:1782241605.696725:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140121856:0@lo:8:kworker.0 00000100:00100000:1.0:1782241605.696751:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241605.697036:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140121856 00000100:00100000:2.0:1782241605.697041:0:24124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140121856 00000100:00100000:2.0:1782241605.697065:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782241605.697070:0:24124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1868815140121856:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1782241605.697109:0:24124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1868815140121856:12345-0@lo:8:kworker.0 Request processed in 37us (357us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782241605.697115:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000004:2.0:1782241605.697232:0:24953:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1782241605.697246:0:24953:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff890d45bccd40) 00000020:00000080:2.0:1782241605.697266:0:24953:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1782241605.697450:0:24953:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e735c9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1782241605.697454:0:24953:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e735c9000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1782241605.697457:0:24953:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e735c9000 3 00010000:00080000:2.0:1782241605.697483:0:24953:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e449f9800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.158@tcp at head 00000100:00100000:1.0:1782241605.698467:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782241605.698476:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241605.698482:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782241605.698486:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140121856:0@lo:8:kworker.0 00000100:00100000:3.0:1782241605.701982:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140121088:0@lo:400:kworker.0 00000100:00100000:3.0:1782241605.702015:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140121728:0@lo:400:kworker.0 00000100:00100000:3.0:1782241605.702028:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140121216:0@lo:400:kworker.0 00010000:00080000:3.0:1782241605.702042:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676c000 x1868815140121984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241605.702053:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140121984:0@lo:400:kworker.0 00010000:00010000:2.0:1782241605.703216:0:24953:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00080000:0.0:1782241605.703330:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241605.703337:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241605.703340:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:2.0:1782241605.703342:0:24953:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1782241605.703389:0:24953:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782241605.703401:0:24953:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc9959f2fb1e1b51d 00000100:00080000:2.0:1782241605.703410:0:24953:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782241605.703416:0:24953:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff890e449f9800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241605.703449:0:24953:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e77fcd880 x1868815140122368/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241605.703475:0:24953:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00080000:3.0:1782241605.705235:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676fb80 x1868815140121472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241605.705254:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140121472:0@lo:400:kworker.0 00010000:00080000:3.0:1782241605.705270:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676ca80 x1868815140122112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241605.705358:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140122112:0@lo:400:kworker.0 00000100:00100000:3.0:1782241605.705375:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140121600:0@lo:400:kworker.0 00010000:00080000:3.0:1782241605.705394:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676d880 x1868815140122240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241605.705402:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140122240:0@lo:400:kworker.0 00000100:00100000:1.0:1782241605.707507:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1868815140122368:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782241605.707585:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1782241605.709668:0:24953:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1782241605.709787:0:24939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1782241605.709829:0:24939:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782241605.711412:0:24939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b4f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b4fa expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241605.711425:0:24939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4499aa00/0xc9959f2fb1e1b4f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b4fa expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782241605.711488:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782241605.711490:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782241605.711492:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241605.711493:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241605.711494:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241605.711496:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241605.711497:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782241605.711499:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241605.711500:0:24939:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782241605.711504:0:24939:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1782241605.711506:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782241605.711507:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782241605.711508:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241605.711509:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241605.711511:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241605.711512:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241605.711513:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782241605.711514:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241605.711515:0:24939:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782241605.711539:0:24939:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782241605.711558:0:24939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140122496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782241605.711626:0:24939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241605.712508:0:24939:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241605.712649:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140122368 00000100:00100000:3.0:1782241605.713012:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140122496 00000100:00100000:3.0:1782241605.713021:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140122496 00000100:00100000:3.0:1782241605.713080:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782241605.713089:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140122496:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782241605.713137:0:22605:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782241605.713153:0:22605:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1782241605.713379:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140122368 00000100:00100000:2.0:1782241605.713474:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782241605.713479:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815140122368:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1782241605.713503:0:22612:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:2.0:1782241605.713540:0:22612:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc9959f2fb1e1b524 00000004:00100000:2.0:1782241605.713555:0:22612:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782241605.713586:0:22612:0:(import.c:65:import_set_state_nolock()) ffff890e72c02800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241605.713672:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1868815140122368:12345-0@lo:38:llog_process_th.0 Request processed in 190us (6086us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241605.713680:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1782241605.714204:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e77fcd880 x1868815140122368/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241605.714217:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782241605.714226:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1782241605.714234:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782241605.714240:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1782241605.714242:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e449f9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782241605.714248:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1868815140122368:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1782241605.725187:0:22605:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782241605.725260:0:22605:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1782241605.727192:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:24939:x1868815140122496:12345-0@lo:253:mount.lustre.0 Request processed in 14093us (15555us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241605.727208:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782241605.727329:0:24939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23eacdb9-0e56-4c3a-b421-5efac43515c0:24939:1868815140122496:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782241605.727363:0:24939:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782241605.727367:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782241605.727368:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782241605.727370:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241605.727372:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241605.727373:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241605.727374:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241605.727376:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782241605.727378:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241605.727379:0:24939:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782241605.727397:0:24939:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1782241605.728588:0:22627:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782241605.728595:0:22627:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782241605.728616:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241605.728649:0:22627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b3bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b3b8 expref: 23 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241605.728679:0:22627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b3cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b3c6 expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241605.728686:0:22627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241605.728726:0:22627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b3cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b3c6 expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241605.728741:0:22627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b3cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b3c6 expref: 23 pid: 22604 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241605.728779:0:22627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140122624:0@lo:104: 00000001:00000004:3.0:1782241605.730004:0:24939:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1782241605.730560:0:22627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241605.730633:0:22627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b3bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b3b8 expref: 23 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241605.730646:0:22627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b3bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b3b8 expref: 23 pid: 22606 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241605.730679:0:22627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140122752:0@lo:104: 00000100:00100000:2.0:1782241605.730704:0:22627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241605.730726:0:22627:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503a9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241605.732175:0:22596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140122624 00000100:00100000:0.0:1782241605.732187:0:22596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140122624 00000100:00100000:0.0:1782241605.732225:0:22596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140122752 00000100:00100000:0.0:1782241605.732227:0:22596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140122752 00000100:00100000:0.0:1782241605.732241:0:22596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241605.732250:0:22596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+4:22627:x1868815140122624:12345-0@lo:104: 00010000:00010000:0.0:1782241605.732265:0:22596:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732343:0:22596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782241605.732350:0:22596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+4:22627:x1868815140122624:12345-0@lo:104: Request processed in 101us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.732364:0:22596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241605.732381:0:22596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241605.732387:0:22596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:22627:x1868815140122752:12345-0@lo:104: 00010000:00010000:0.0:1782241605.732394:0:22596:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732430:0:22596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782241605.732435:0:22596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:22627:x1868815140122752:12345-0@lo:104: Request processed in 49us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.732440:0:22596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1782241605.732457:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782241605.732463:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732471:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241605.732475:0:23368:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732484:0:23368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241605.732491:0:23368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241605.732497:0:23368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782241605.732530:0:23368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732537:0:23368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241605.732563:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732570:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e7c310200/0xc9959f2fb1e1b3c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b3cd expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732584:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241605.732587:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732593:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241605.732596:0:23368:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732602:0:23368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241605.732609:0:23368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241605.732613:0:23368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782241605.732626:0:23368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732633:0:23368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241605.732639:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732645:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e1b3b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b3bf expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732681:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241605.732683:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241605.732685:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241605.732691:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241605.732709:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140122880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241605.732748:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.732801:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241605.732808:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140123008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241605.732829:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241605.732861:0:22598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140122880 00000100:00100000:0.0:1782241605.732866:0:22598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140122880 00010000:00010000:0.0:1782241605.732884:0:22598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b3cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b3c6 expref: 24 pid: 22604 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241605.732904:0:22598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140123008 00000100:00100000:0.0:1782241605.732907:0:22598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140123008 00010000:00010000:0.0:1782241605.732918:0:22598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b3bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b3b8 expref: 25 pid: 22606 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241605.732936:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241605.732942:0:22598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+25:3637:x1868815140122880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241605.732953:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241605.732958:0:22598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b3cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b3c6 expref: 25 pid: 22604 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.732982:0:22598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b3cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b3c6 expref: 25 pid: 22604 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.733701:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241605.733753:0:22598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+25:3637:x1868815140122880:12345-0@lo:103:ldlm_bl.0 Request processed in 809us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.733784:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241605.733803:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241605.733811:0:22598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3637:x1868815140123008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241605.733820:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241605.733824:0:22598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b3bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b3b8 expref: 24 pid: 22606 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.733834:0:22598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b3bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b3b8 expref: 24 pid: 22606 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.733847:0:22598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.733854:0:22598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782241605.733868:0:22598:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011186535s 00010000:00010000:0.0:1782241605.733873:0:22598:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.733879:0:22598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.733885:0:22598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.733901:0:22598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.733908:0:22598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241605.733912:0:22598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.733919:0:22598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.733928:0:22598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.733937:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241605.734087:0:22598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3637:x1868815140123008:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241605.734096:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1782241605.734147:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b3cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b3c6 expref: 23 pid: 22604 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241605.734155:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140123008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241605.734159:0:22627:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140122624:0@lo:104: 00000100:00100000:3.0:1782241605.734164:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140122880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241605.734168:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b3bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b3b8 expref: 22 pid: 22606 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241605.734174:0:22627:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22627:1868815140122752:0@lo:104: 00010000:00010000:0.0:1782241605.734187:0:22627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.734196:0:22627:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.734209:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241605.734216:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e43fad200/0xc9959f2fb1e1b52b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782241605.734268:0:24939:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1782241605.734349:0:24939:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1782241605.734394:0:24939:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782241605.734445:0:24939:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782241605.734462:0:24939:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1782241605.734485:0:24939:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1782241605.735588:0:24939:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241605.736553:0:24939:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1782241606.404970:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140123136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241606.405039:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241606.405139:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140123136 00000100:00100000:0.0:1782241606.405147:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140123136 00000100:00100000:0.0:1782241606.405205:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241606.405215:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140123136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241606.405245:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1782241606.405305:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140123136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241606.405311:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241606.405358:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140123136:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1782241606.406572:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782241606.837419:0:25006:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782241606.837623:0:25006:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782241607.431984:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140123264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241607.432050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241607.432105:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140123264 00000100:00100000:3.0:1782241607.432112:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140123264 00000100:00100000:3.0:1782241607.432176:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782241607.432184:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140123264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241607.432216:0:22616:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1782241607.432257:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140123264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241607.432273:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782241607.432315:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140123264:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782241607.437917:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241607.443695:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241607.443724:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140123392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241607.443821:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241607.443870:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140123392 00000100:00100000:2.0:1782241607.443877:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140123392 00000100:00100000:2.0:1782241607.443922:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782241607.443931:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140123392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782241607.443964:0:23684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782241607.444009:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140123392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241607.444017:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782241607.444059:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140123392:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1782241607.688161:0:22609:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782241607.688419:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d46921800 from 14 10000000:01000000:1.0:1782241607.688423:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782241607.688468:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c311a00/0xc9959f2fb1e1b532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241607.688479:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e7c311a00/0xc9959f2fb1e1b532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241607.688490:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e7c311a00/0xc9959f2fb1e1b532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241607.688515:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140123520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782241607.688583:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241607.688636:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241607.688710:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140123520 00000100:00100000:3.0:1782241607.688717:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140123520 00000100:00100000:3.0:1782241607.688806:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782241607.688814:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:22609:x1868815140123520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241607.688828:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241607.688841:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eb200/0xc9959f2fb1e1b539 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b532 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241607.688862:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eb200/0xc9959f2fb1e1b539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b532 expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241607.688873:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eb200/0xc9959f2fb1e1b539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b532 expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241607.688882:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb200, rc 0) 00000100:00100000:3.0:1782241607.688922:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:22609:x1868815140123520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241607.688928:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782241607.690789:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140123520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241607.690827:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e7c311a00/0xc9959f2fb1e1b532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b539 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241607.690839:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e7c311a00/0xc9959f2fb1e1b532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b539 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241607.690914:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140123648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782241607.690967:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241607.691182:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241607.691478:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140123648 00000100:00100000:3.0:1782241607.691485:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140123648 00000100:00100000:3.0:1782241607.691538:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782241607.691548:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:22609:x1868815140123648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1782241607.691570:0:22605:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782241607.691585:0:22605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782241607.691589:0:22605:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1782241607.691691:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:22609:x1868815140123648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241607.691700:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782241607.691744:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140123648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782241607.691936:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782241607.691949:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e7c311a00/0xc9959f2fb1e1b532 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b539 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241607.691959:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e7c311a00/0xc9959f2fb1e1b532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b539 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241607.691967:0:22609:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782241607.691970:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d46713800 from 14 10000000:01000000:3.0:1782241607.691972:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782241607.691998:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eaa00/0xc9959f2fb1e1b540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241607.692081:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779eaa00/0xc9959f2fb1e1b540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241607.692091:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779eaa00/0xc9959f2fb1e1b540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241607.692107:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140123776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241607.692137:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241607.692209:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241607.702952:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140123776 00000100:00100000:0.0:1782241607.702967:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140123776 00000100:00100000:1.0:1782241607.703086:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782241607.703097:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:22609:x1868815140123776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241607.703123:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241607.703142:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e7c311600/0xc9959f2fb1e1b547 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b540 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241607.703183:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c311600/0xc9959f2fb1e1b547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b540 expref: 24 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241607.703195:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e7c311600/0xc9959f2fb1e1b547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b540 expref: 24 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241607.703205:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c311600, rc 0) 00000100:00100000:1.0:1782241607.703301:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:22609:x1868815140123776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (11163us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241607.703308:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782241607.703462:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d637480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140123776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241607.703481:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779eaa00/0xc9959f2fb1e1b540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b547 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241607.703492:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779eaa00/0xc9959f2fb1e1b540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b547 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241607.703558:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140123904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782241607.703600:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241607.703652:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e412ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241607.703946:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140123904 00000100:00100000:1.0:1782241607.703951:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140123904 00000100:00100000:1.0:1782241607.703985:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782241607.703993:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:22609:x1868815140123904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782241607.704006:0:22604:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782241607.704022:0:22604:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782241607.704026:0:22604:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1782241607.704096:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:22609:x1868815140123904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241607.704104:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782241607.704180:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140123904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782241607.704236:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782241607.704244:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eaa00/0xc9959f2fb1e1b540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b547 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241607.704264:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779eaa00/0xc9959f2fb1e1b540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b547 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241608.453154:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241608.454038:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140124032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241608.454110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241608.454169:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140124032 00000100:00100000:1.0:1782241608.454176:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140124032 00000100:00100000:1.0:1782241608.454243:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241608.454252:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140124032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241608.454281:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1782241608.454324:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140124032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241608.454331:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241608.454380:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140124032:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782241608.454461:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782241609.477321:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782241609.929391:0:22647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782241610.501427:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782241611.019307:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241611.019314:0:22059:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782241611.019317:0:22059:0:(import.c:65:import_set_state_nolock()) ffff890d48885000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241611.019329:0:22059:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff890d48885000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241611.019351:0:22059:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4836c000 x1868815140124544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241611.019382:0:22059:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241611.019385:0:22059:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782241611.019387:0:22059:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241611.019391:0:22059:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890e449fb000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241611.019401:0:22059:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4836f480 x1868815140125056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782241611.019470:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140124416:0@lo:400:kworker.0 00000100:00100000:1.0:1782241611.019533:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241611.019579:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140125184:0@lo:400:kworker.0 00000100:00100000:1.0:1782241611.019605:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241611.019622:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140125696:0@lo:400:kworker.0 00000100:00100000:1.0:1782241611.019658:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241611.019682:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782241611.019687:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140124672:0@lo:400:kworker.0 00000100:00100000:1.0:1782241611.019707:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241611.019721:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140125312:0@lo:400:kworker.0 00000100:00100000:1.0:1782241611.019782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241611.019809:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140124544:0@lo:8:kworker.0 00000100:00100000:1.0:1782241611.019832:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241611.019848:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140125056:0@lo:8:kworker.0 00000100:00100000:1.0:1782241611.019866:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241611.019894:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140124416 00000100:00100000:1.0:1782241611.019901:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140124416 00000100:00100000:1.0:1782241611.019942:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140124544 00000100:00100000:1.0:1782241611.019945:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140124544 00000100:00100000:1.0:1782241611.019953:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140125056 00000100:00100000:1.0:1782241611.019956:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140125056 00000100:00100000:1.0:1782241611.019966:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241611.019974:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140124416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241611.020024:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140124416:12345-0@lo:400:kworker.0 Request processed in 50us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241611.020032:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241611.020048:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782241611.020053:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815140124544:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1782241611.020078:0:24572:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:1.0:1782241611.020105:0:24572:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1b54e 00002000:00100000:1.0:1782241611.020118:0:24572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff890e735cb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1782241611.020127:0:24572:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1782241611.020131:0:24572:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782241611.020294:0:24572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782241611.020318:0:24572:0:(import.c:65:import_set_state_nolock()) ffff890e735ca000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241611.020355:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1868815140124544:12345-0@lo:8:kworker.0 Request processed in 300us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241611.020362:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782241611.020375:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782241611.020379:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815140125056:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1782241611.020394:0:24572:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:1.0:1782241611.020409:0:24572:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1b555 00002000:00100000:1.0:1782241611.020415:0:24572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff890e735c8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1782241611.020419:0:24572:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1782241611.020420:0:24572:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782241611.020441:0:24572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1782241611.020453:0:24572:0:(import.c:65:import_set_state_nolock()) ffff890e735ce800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241611.020479:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3636:x1868815140125056:12345-0@lo:8:kworker.0 Request processed in 98us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241611.020486:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782241611.020508:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140125184 00000100:00100000:1.0:1782241611.020512:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140125184 00000100:00100000:1.0:1782241611.020530:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140125696 00000100:00100000:1.0:1782241611.020532:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140125696 00000100:00100000:1.0:1782241611.020544:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140124672 00000100:00100000:3.0:1782241611.020653:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140124160:0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.020690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241611.020722:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140124800:0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.020745:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241611.020782:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140125440:0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.020811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241611.020824:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782241611.020830:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140124288:0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.020849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241611.020866:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140124928:0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.020884:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241611.020899:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140125568:0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.020922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241611.020943:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140125312 00000100:00100000:3.0:1782241611.020947:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140125312 00000100:00100000:3.0:1782241611.020966:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140125440 00000100:00100000:3.0:1782241611.020968:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140125440 00000100:00100000:3.0:1782241611.020981:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140125568 00000100:00100000:3.0:1782241611.020983:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140125568 00000100:00100000:3.0:1782241611.020996:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782241611.021003:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140125184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021036:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140125184:12345-0@lo:400:kworker.0 Request processed in 33us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241611.021043:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782241611.021054:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782241611.021060:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140125696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021085:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140125696:12345-0@lo:400:kworker.0 Request processed in 25us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241611.021090:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782241611.021101:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782241611.021105:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140125312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021140:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140125312:12345-0@lo:400:kworker.0 Request processed in 35us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241611.021147:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782241611.021161:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782241611.021167:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140125440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021198:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140125440:12345-0@lo:400:kworker.0 Request processed in 31us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241611.021203:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782241611.021213:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782241611.021219:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140125568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021244:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140125568:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241611.021250:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1782241611.021265:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241611.021268:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782241611.021270:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241611.021278:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140124160 00000100:00100000:3.0:1782241611.021281:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140124160 00000100:00100000:3.0:1782241611.021304:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782241611.021310:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3639:x1868815140124160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021336:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3639:x1868815140124160:12345-0@lo:400:kworker.0 Request processed in 26us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241611.021342:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782241611.021366:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140124800 00000100:00100000:3.0:1782241611.021369:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140124800 00000100:00100000:3.0:1782241611.021390:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140124288 00000100:00100000:3.0:1782241611.021393:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140124288 00000100:00100000:3.0:1782241611.021414:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241611.021419:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140124800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021450:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140124800:12345-0@lo:400:kworker.0 Request processed in 31us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241611.021456:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241611.021467:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782241611.021473:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140124288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021498:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140124288:12345-0@lo:400:kworker.0 Request processed in 26us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241611.021504:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782241611.021522:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140124928 00000100:00100000:3.0:1782241611.021525:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140124928 00000100:00100000:3.0:1782241611.021559:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782241611.021565:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140124928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021594:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140124928:12345-0@lo:400:kworker.0 Request processed in 29us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241611.021599:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1782241611.021620:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241611.021646:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140124288:0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021657:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140124928:0@lo:400:kworker.0 00010000:00080000:3.0:1782241611.021668:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4836c380 x1868815140125568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241611.021677:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140125568:0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021684:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140124160:0@lo:400:kworker.0 00000100:00100000:3.0:1782241611.021703:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140124800:0@lo:400:kworker.0 00010000:00080000:3.0:1782241611.021712:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4836df80 x1868815140125440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241611.021720:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140125440:0@lo:400:kworker.0 00000100:00100000:1.0:1782241611.022345:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140124672 00000100:00100000:1.0:1782241611.022383:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782241611.022390:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140124672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241611.022445:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140124672:12345-0@lo:400:kworker.0 Request processed in 55us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241611.022451:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1782241611.022497:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4836f100 x1868815140124672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241611.022508:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140124672:0@lo:400:kworker.0 00010000:00080000:1.0:1782241611.022519:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4836d880 x1868815140125312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241611.022527:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140125312:0@lo:400:kworker.0 00000100:00100000:1.0:1782241611.022539:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140124416:0@lo:400:kworker.0 00010000:00080000:1.0:1782241611.022564:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4836d180 x1868815140125184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241611.022573:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140125184:0@lo:400:kworker.0 00010000:00080000:1.0:1782241611.022585:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4836e680 x1868815140125696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241611.022593:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140125696:0@lo:400:kworker.0 00010000:00080000:1.0:1782241611.022629:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4836c000 x1868815140124544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782241611.022641:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1782241611.022649:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782241611.022654:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1782241611.022658:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48885000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782241611.022678:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782241611.022685:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140124544:0@lo:8:kworker.0 00010000:00080000:1.0:1782241611.022699:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4836f480 x1868815140125056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782241611.022709:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1782241611.022714:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782241611.022717:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1782241611.022719:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e449fb000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782241611.022731:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782241611.022734:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140125056:0@lo:8:kworker.0 00000004:00080000:1.0:1782241611.022799:0:22638:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1782241611.022816:0:22638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22638:1868815140125952:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1782241611.022845:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241611.023264:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140125824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241611.023296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241611.023331:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140125824 00000100:00100000:0.0:1782241611.023336:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140125824 00000100:00100000:0.0:1782241611.023370:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782241611.023377:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140125824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241611.023399:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782241611.023432:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140125824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241611.023439:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782241611.023469:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4676ed80 x1868815140125824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241611.023484:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140125824:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1782241611.023535:0:23356:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1782241611.023563:0:23356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23356:1868815140126208:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1782241611.023588:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241611.023612:0:23356:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503a9540 going to sleep for 11 seconds 00000100:00100000:0.0:1782241611.023625:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140125952 00000100:00100000:0.0:1782241611.023629:0:24124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140125952 00000100:00100000:0.0:1782241611.023649:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140126208 00000100:00100000:0.0:1782241611.023652:0:24124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140126208 00000100:00100000:0.0:1782241611.023668:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782241611.023674:0:24124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22638:x1868815140125952:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1782241611.024049:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782241611.024058:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23356:x1868815140126208:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1782241611.024168:0:22637:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782241611.024267:0:22637:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 674282509762ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782241611.024274:0:22637:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1782241611.024300:0:23355:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782241611.024338:0:23355:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 674282580562ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782241611.024342:0:23355:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1782241611.024461:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241611.024473:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140126080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241611.024514:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782241611.024544:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241611.024570:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140126080 00000100:00100000:3.0:1782241611.024575:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140126080 00000100:00100000:3.0:1782241611.024603:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782241611.024610:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1868815140126080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782241611.024623:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1782241611.024658:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1868815140126080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241611.024665:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782241611.024696:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48835880 x1868815140126080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241611.024711:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140126080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241611.025898:0:22638:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f936c0 going to sleep for 11 seconds 00000004:00080000:3.0:1782241611.035455:0:22592:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1782241611.039375:0:24124:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1782241611.039386:0:24124:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1782241611.039393:0:24124:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00002000:00080000:1.0:1782241611.039902:0:24125:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1782241611.039908:0:24125:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1782241611.040015:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23356:x1868815140126208:12345-0@lo:7:osp-pre-1-1.0 Request processed in 15953us (16421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241611.040026:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1782241611.040137:0:23356:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a4aa00 x1868815140126208/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782241627 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241611.040153:0:23356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23356:1868815140126208:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1782241611.040166:0:23356:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1782241611.040203:0:23356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23356:1868815140126336:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1782241611.040236:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241611.040269:0:23356:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503a9540 going to sleep for 11 seconds 00000100:00100000:1.0:1782241611.040322:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140126336 00000100:00100000:1.0:1782241611.040328:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140126336 00000100:00100000:1.0:1782241611.040369:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782241611.040377:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23356:x1868815140126336:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1782241611.040400:0:24123:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1782241611.040431:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23356:x1868815140126336:12345-0@lo:5:osp-pre-1-1.0 Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241611.040438:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1782241611.040473:0:23356:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4836c000 x1868815140126336/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241627 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241611.040482:0:23356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23356:1868815140126336:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1782241611.040490:0:23356:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1782241611.040513:0:23356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23356:1868815140126464:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1782241611.040535:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241611.040561:0:23356:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f93240 going to sleep for 11 seconds 00000100:00100000:1.0:1782241611.040573:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140126464 00000100:00100000:1.0:1782241611.040576:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140126464 00000100:00100000:1.0:1782241611.040596:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782241611.040602:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23356:x1868815140126464:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1782241611.040624:0:24125:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:3.0:1782241611.060988:0:23345:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:3.0:1782241611.066566:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241611.066581:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b55c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.066599:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1782241611.066604:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241611.066611:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b55c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.066629:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b55c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.066640:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b55c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.066648:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b55c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.066678:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241611.067128:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241611.067136:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b55c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.067145:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241611.067149:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b55c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.067159:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b55c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.067177:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b55c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.067195:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b55c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.067215:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241611.067216:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241611.067218:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241611.067571:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241611.067578:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009934496/0xc9959f2fb1e1b563 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.067588:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1782241611.067591:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241611.067596:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009934496/0xc9959f2fb1e1b563 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.067605:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009934496/0xc9959f2fb1e1b563 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.067613:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009934496/0xc9959f2fb1e1b563 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.067620:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009934496/0xc9959f2fb1e1b563 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.067636:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241611.067910:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241611.067916:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009934496/0xc9959f2fb1e1b563 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.067923:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241611.067927:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009934496/0xc9959f2fb1e1b563 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.067935:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009934496/0xc9959f2fb1e1b563 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.067946:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009934496/0xc9959f2fb1e1b563 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.067952:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009934496/0xc9959f2fb1e1b563 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.067965:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.067966:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.067968:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241611.068344:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241611.068350:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b56a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.068360:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1782241611.068362:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241611.068367:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b56a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.068387:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b56a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.068395:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b56a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.068402:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b56a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.068427:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241611.068657:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241611.068665:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b56a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.068675:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eba00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241611.068678:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b56a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.068699:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b56a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.068713:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b56a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.068721:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b56a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.068741:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.068743:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.068745:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241611.069506:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241611.069515:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b571 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.069528:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1782241611.069532:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241611.069537:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b571 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.069561:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b571 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.069570:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b571 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.069591:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b571 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.069608:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241611.069944:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241611.069956:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b571 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.069965:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241611.069968:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b571 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.069976:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b571 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.069990:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b571 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.069998:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b571 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.070013:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241611.070014:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241611.070016:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241611.071035:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241611.071044:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017dfcc5f/0xc9959f2fb1e1b578 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.071056:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1782241611.071059:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241611.071064:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017dfcc5f/0xc9959f2fb1e1b578 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.071084:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017dfcc5f/0xc9959f2fb1e1b578 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.071094:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017dfcc5f/0xc9959f2fb1e1b578 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.071101:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017dfcc5f/0xc9959f2fb1e1b578 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.071122:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241611.071463:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241611.071470:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017dfcc5f/0xc9959f2fb1e1b578 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.071477:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241611.071480:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017dfcc5f/0xc9959f2fb1e1b578 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.071488:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017dfcc5f/0xc9959f2fb1e1b578 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.071502:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017dfcc5f/0xc9959f2fb1e1b578 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.071508:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017dfcc5f/0xc9959f2fb1e1b578 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.071523:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.071525:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.071526:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241611.072121:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241611.072130:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f3d91a4/0xc9959f2fb1e1b57f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.072141:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1782241611.072145:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241611.072149:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f3d91a4/0xc9959f2fb1e1b57f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.072160:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f3d91a4/0xc9959f2fb1e1b57f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.072168:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f3d91a4/0xc9959f2fb1e1b57f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.072187:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f3d91a4/0xc9959f2fb1e1b57f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.072208:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241611.072329:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241611.072336:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f3d91a4/0xc9959f2fb1e1b57f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.072345:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241611.072349:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f3d91a4/0xc9959f2fb1e1b57f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.072358:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f3d91a4/0xc9959f2fb1e1b57f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.072371:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f3d91a4/0xc9959f2fb1e1b57f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.072389:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f3d91a4/0xc9959f2fb1e1b57f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.072404:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.072406:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.072407:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241611.073275:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241611.073284:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b586 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.073296:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1782241611.073299:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241611.073304:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b586 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.073314:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b586 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.073322:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b586 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.073329:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b586 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.073353:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241611.073479:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241611.073491:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b586 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.073498:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241611.073502:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b586 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.073510:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b586 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.073524:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b586 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.073530:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2e0a113/0xc9959f2fb1e1b586 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.073556:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.073558:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.073560:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241611.074091:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241611.074098:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b58d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.074114:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1782241611.074117:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241611.074121:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b58d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.074131:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b58d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.074139:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b58d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.074147:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b58d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241611.074162:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241611.074324:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241611.074329:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b58d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.074337:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241611.074340:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b58d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.074359:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b58d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.074371:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b58d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.074379:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bec043f2/0xc9959f2fb1e1b58d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.074393:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.074395:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.074396:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241611.092837:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.092851:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1b594 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.092868:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.092872:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.092878:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1b594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.092895:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1b594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.092906:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1b594 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.092915:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1b594 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.092933:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241611.093039:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241611.093046:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1b594 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.093054:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499bc00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241611.093058:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1b594 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.093067:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1b594 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.093085:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1b594 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.093093:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1b594 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.093115:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.093117:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.093118:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241611.097922:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.097935:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b59b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.097952:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.097956:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.097961:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b59b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.097975:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b59b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.097985:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b59b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.097992:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b59b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098011:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782241611.098353:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.098360:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b5a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098369:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.098373:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.098378:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b5a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098399:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b5a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098408:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b5a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098415:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b5a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098433:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782241611.098444:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782241611.098449:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b59b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098457:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ac00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.098462:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b59b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098471:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b59b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098489:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b59b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098496:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1b59b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098521:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.098525:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b5a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098531:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ba00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.098534:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b5a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098542:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b5a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098566:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b5a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098574:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1b5a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098587:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.098588:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.098591:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241611.098956:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.098962:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b5a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098971:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.098980:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.098984:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b5a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.098993:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b5a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099001:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b5a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099008:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b5a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099028:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782241611.099313:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.099320:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b5b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099328:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.099331:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.099335:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b5b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099344:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b5b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099351:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b5b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099364:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b5b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099377:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782241611.099384:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782241611.099388:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b5a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099396:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.099399:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b5a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099406:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b5a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099418:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b5a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099426:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cca4a612/0xc9959f2fb1e1b5a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099444:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.099447:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b5b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099464:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.099467:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b5b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099475:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b5b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099485:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b5b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099492:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d399d1a/0xc9959f2fb1e1b5b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099504:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.099506:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.099507:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241611.099827:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.099833:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b5b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099842:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.099846:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.099850:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b5b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099859:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b5b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099873:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b5b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099880:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b5b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099893:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241611.099900:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.099904:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b5b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099911:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.099914:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b5b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099923:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b5b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099933:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b5b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099941:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d1aedf/0xc9959f2fb1e1b5b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.099955:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.099961:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.099963:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241611.100213:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.100219:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1b5be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.100227:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.100230:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.100234:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1b5be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.100243:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1b5be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.100252:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1b5be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.100259:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1b5be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.100272:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241611.100279:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.100283:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1b5be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.100291:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.100294:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1b5be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.100312:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1b5be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.100323:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1b5be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.100331:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1b5be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.100344:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.100346:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.100348:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241611.104854:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.104868:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c320f2dd/0xc9959f2fb1e1b5c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.104886:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.104891:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.104898:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c320f2dd/0xc9959f2fb1e1b5c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.104912:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c320f2dd/0xc9959f2fb1e1b5c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.104923:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c320f2dd/0xc9959f2fb1e1b5c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.104939:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c320f2dd/0xc9959f2fb1e1b5c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.104961:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241611.104977:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.104982:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c320f2dd/0xc9959f2fb1e1b5c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.104990:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.104994:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c320f2dd/0xc9959f2fb1e1b5c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105002:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c320f2dd/0xc9959f2fb1e1b5c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105019:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c320f2dd/0xc9959f2fb1e1b5c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105026:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c320f2dd/0xc9959f2fb1e1b5c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105047:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.105049:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.105051:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241611.105555:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.105570:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b5cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105580:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.105583:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.105588:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b5cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105598:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b5cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105606:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b5cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105614:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b5cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105627:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241611.105633:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.105637:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b5cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105644:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.105647:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b5cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105656:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b5cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105673:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b5cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105681:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b5cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.105695:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.105697:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.105698:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.105824:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.106047:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782241611.107110:0:24940:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1782241611.107134:0:24940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1782241611.107139:0:24940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1782241611.107335:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23356:x1868815140126464:12345-0@lo:5:osp-pre-1-1.0 Request processed in 66727us (66793us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1782241611.107346:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782241611.107436:0:23356:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1782241611.107445:0:23356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23356:1868815140126464:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1782241611.107460:0:23356:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1782241611.107506:0:23356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23356:1868815140126592:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1782241611.107541:0:23356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241611.107582:0:23356:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241611.107640:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140126592 00000100:00100000:3.0:1782241611.107646:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140126592 00000100:00100000:3.0:1782241611.107682:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782241611.107689:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23356:x1868815140126592:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1782241611.107750:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23356:x1868815140126592:12345-0@lo:900:osp-pre-1-1.0 Request processed in 61us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241611.107777:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782241611.107914:0:23356:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77fcf100 x1868815140126592/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782241627 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241611.107926:0:23356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23356:1868815140126592:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1782241611.108156:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241611.108165:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1b5d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.108179:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=674s v=(0 0) 00010000:00010000:2.0:1782241611.108184:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241611.108190:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1b5d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.108203:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1b5d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.108213:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1b5d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.108232:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1b5d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.108255:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241611.108599:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.108607:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1b5d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.108616:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fade00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.108621:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1b5d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.108630:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1b5d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.108648:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1b5d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.108656:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1b5d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.108686:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.108688:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.108690:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241611.109322:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241611.109331:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b5da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.109343:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=674s v=(0 0) 00010000:00010000:2.0:1782241611.109346:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241611.109350:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b5da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.109360:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b5da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.109368:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b5da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.109375:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b5da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.109440:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782241611.111992:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241611.112004:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b5e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.112027:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=674s v=(0 0) 00010000:00010000:2.0:1782241611.112031:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241611.112037:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b5e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.112050:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b5e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.112060:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b5e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.112069:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b5e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.116525:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241611.116539:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b5da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.116576:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241611.116581:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b5da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.116593:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b5da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.116615:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b5da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.116624:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1b5da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.116648:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241611.116652:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b5e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.116659:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43faca00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241611.116663:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b5e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.116671:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b5e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.116681:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b5e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.116695:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.116697:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.116699:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.121738:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.123448:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782241611.123463:0:24124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1b5e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782241611.133925:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241611.133939:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1b5e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.133956:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1782241611.133960:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241611.133971:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1b5e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.133986:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1b5e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.133996:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1b5e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.134004:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1b5e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.134028:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241611.134363:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241611.134370:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1b5e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.134380:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241611.134384:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1b5e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.134406:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1b5e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.134423:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1b5e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.134432:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1b5e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.134452:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.134454:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.134455:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241611.135981:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241611.135993:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b5ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.136022:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1782241611.136027:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241611.136033:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b5ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.136045:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b5ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.136053:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b5ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.136062:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b5ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.136089:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241611.136352:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.136359:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b5ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.136368:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.136373:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b5ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.136381:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b5ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.136398:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b5ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.136406:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1b5ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.136424:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.136425:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.136427:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241611.136590:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241611.136596:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b5f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.136605:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1782241611.136608:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241611.136612:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b5f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.136622:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b5f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.136642:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b5f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.136650:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b5f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.136668:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782241611.137028:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241611.137035:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b5fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.137043:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1782241611.137046:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241611.137050:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b5fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.137060:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b5fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.137067:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b5fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.137074:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b5fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.137194:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1782241611.140080:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241611.140095:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b604 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.140111:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1782241611.140115:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241611.140120:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b604 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.140133:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b604 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.140143:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b604 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.140150:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b604 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142613:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782241611.142627:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b5f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142653:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.142658:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b5f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142668:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b5f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142688:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b5f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142695:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1b5f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142717:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782241611.142732:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b5fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142739:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eba00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.142743:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b5fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142750:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b5fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142783:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b5fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142798:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007af5b260/0xc9959f2fb1e1b5fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142813:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.142817:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b604 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142824:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.142827:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b604 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142836:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b604 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142847:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b604 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.142855:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.142856:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.142858:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.143620:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.146853:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782241611.146868:0:24124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cd80d01/0xc9959f2fb1e1b604 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.147141:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241611.148283:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241611.148294:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b60b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.148318:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1782241611.148322:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241611.148329:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b60b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.148344:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b60b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.148354:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b60b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.148363:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b60b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.148416:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782241611.150057:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241611.150070:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001de6901a/0xc9959f2fb1e1b612 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.150086:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1782241611.150091:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241611.150097:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001de6901a/0xc9959f2fb1e1b612 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.150110:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001de6901a/0xc9959f2fb1e1b612 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.150132:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001de6901a/0xc9959f2fb1e1b612 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.150139:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001de6901a/0xc9959f2fb1e1b612 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.153165:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782241611.153177:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b60b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.153190:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.153201:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b60b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.153213:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b60b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.153232:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b60b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.153240:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aecf6646/0xc9959f2fb1e1b60b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.153258:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.153262:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001de6901a/0xc9959f2fb1e1b612 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.153268:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.153271:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001de6901a/0xc9959f2fb1e1b612 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.153278:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001de6901a/0xc9959f2fb1e1b612 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.153287:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001de6901a/0xc9959f2fb1e1b612 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.153295:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.153301:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.153304:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.153476:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782241611.153484:0:24124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001de6901a/0xc9959f2fb1e1b612 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.155203:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241611.155517:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241611.155530:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007182473f/0xc9959f2fb1e1b619 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.155556:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1782241611.155562:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241611.155567:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007182473f/0xc9959f2fb1e1b619 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.155584:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007182473f/0xc9959f2fb1e1b619 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.155597:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007182473f/0xc9959f2fb1e1b619 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.155620:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007182473f/0xc9959f2fb1e1b619 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.155640:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241611.155879:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.155889:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007182473f/0xc9959f2fb1e1b619 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.155897:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.155905:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007182473f/0xc9959f2fb1e1b619 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.155914:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007182473f/0xc9959f2fb1e1b619 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.155936:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007182473f/0xc9959f2fb1e1b619 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.155946:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007182473f/0xc9959f2fb1e1b619 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.155967:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.155969:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.155971:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241611.158651:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.158665:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b620 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.158680:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.158684:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.158696:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b620 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.158711:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b620 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.158734:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b620 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.158743:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b620 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.158786:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241611.159007:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241611.159014:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b620 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.159023:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241611.159028:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b620 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.159037:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b620 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.159053:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b620 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.159060:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b620 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.159076:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.159078:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.159080:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241611.168979:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.168996:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411f1d8d/0xc9959f2fb1e1b627 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169011:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.169016:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.169022:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411f1d8d/0xc9959f2fb1e1b627 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169036:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000411f1d8d/0xc9959f2fb1e1b627 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169046:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411f1d8d/0xc9959f2fb1e1b627 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169067:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000411f1d8d/0xc9959f2fb1e1b627 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169088:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241611.169506:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241611.169513:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000411f1d8d/0xc9959f2fb1e1b627 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.169521:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861a00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241611.169525:0:23368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000411f1d8d/0xc9959f2fb1e1b627 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.169534:0:23368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000411f1d8d/0xc9959f2fb1e1b627 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.169561:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000411f1d8d/0xc9959f2fb1e1b627 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.169576:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000411f1d8d/0xc9959f2fb1e1b627 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241611.169597:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.169599:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241611.169601:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241611.169686:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.169691:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3fe7fc7/0xc9959f2fb1e1b62e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169699:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.169702:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.169706:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3fe7fc7/0xc9959f2fb1e1b62e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169716:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3fe7fc7/0xc9959f2fb1e1b62e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169835:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3fe7fc7/0xc9959f2fb1e1b62e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169845:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3fe7fc7/0xc9959f2fb1e1b62e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169861:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241611.169869:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241611.169874:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3fe7fc7/0xc9959f2fb1e1b62e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169888:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861c00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241611.169891:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3fe7fc7/0xc9959f2fb1e1b62e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169900:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3fe7fc7/0xc9959f2fb1e1b62e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169910:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3fe7fc7/0xc9959f2fb1e1b62e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169917:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3fe7fc7/0xc9959f2fb1e1b62e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.169931:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.169933:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241611.169934:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241611.170305:0:24124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241611.170311:0:24124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720aa7ab/0xc9959f2fb1e1b635 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.170321:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1782241611.170324:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241611.170328:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000720aa7ab/0xc9959f2fb1e1b635 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.170338:0:24124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000720aa7ab/0xc9959f2fb1e1b635 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.170352:0:24124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720aa7ab/0xc9959f2fb1e1b635 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.170360:0:24124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000720aa7ab/0xc9959f2fb1e1b635 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241611.171492:0:24124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1782241611.175110:0:24124:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1782241611.175212:0:24124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22638:x1868815140125952:12345-0@lo:5:osp-pre-1-0.0 Request processed in 151531us (152360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241611.175222:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782241611.177689:0:22638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22638:1868815140125952:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1782241611.177708:0:22638:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1782241611.177782:0:22638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22638:1868815140126720:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1782241611.177838:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241611.177864:0:22638:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f936c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241611.177894:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140126720 00000100:00100000:1.0:1782241611.177900:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140126720 00000100:00100000:1.0:1782241611.177949:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782241611.177958:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22638:x1868815140126720:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1782241611.178004:0:24123:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1782241611.179712:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22638:x1868815140126720:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1750us (1869us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1782241611.179724:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782241611.179810:0:22638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22638:1868815140126720:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1782241611.179823:0:22638:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1782241611.180002:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241611.180017:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000720aa7ab/0xc9959f2fb1e1b635 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.180029:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241611.180034:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000720aa7ab/0xc9959f2fb1e1b635 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.180045:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000720aa7ab/0xc9959f2fb1e1b635 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.180064:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000720aa7ab/0xc9959f2fb1e1b635 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.180072:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000720aa7ab/0xc9959f2fb1e1b635 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241611.180094:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.180096:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241611.180097:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241611.524871:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241611.524893:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140126848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241611.524957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241611.524999:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140126848 00000100:00100000:0.0:1782241611.525007:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140126848 00000100:00100000:0.0:1782241611.525048:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241611.525055:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140126848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241611.525083:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1782241611.525125:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140126848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241611.525132:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241611.525178:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140126848:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1782241611.528972:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241612.554532:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140126976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241612.554624:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241612.554684:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241612.555716:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140127104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241612.555803:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241612.555853:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140126976 00000100:00100000:0.0:1782241612.555860:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140126976 00000100:00100000:0.0:1782241612.555908:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140127104 00000100:00100000:0.0:1782241612.555912:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140127104 00000100:00100000:0.0:1782241612.555935:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782241612.555946:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140126976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241612.555986:0:23684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782241612.556049:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140126976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241612.556058:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782241612.556076:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782241612.556082:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140127104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241612.556098:0:23684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1782241612.556132:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140127104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241612.556138:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782241612.556188:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140127104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241612.556231:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140126976:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1782241612.740504:0:25296:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1782241613.511082:0:23364:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782241613.573256:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140127232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241613.573329:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241613.573380:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140127232 00000100:00100000:0.0:1782241613.573392:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140127232 00000100:00100000:0.0:1782241613.573444:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241613.573452:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140127232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241613.573480:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1782241613.573552:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140127232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241613.573559:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1782241613.573579:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241613.573594:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140127232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782241613.574075:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782241613.689317:0:25348:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782241613.689735:0:25348:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782241614.597847:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782241614.775091:0:25398:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241614.775379:0:25398:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1782241615.148365:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241615.148523:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120092544 00000100:00100000:3.0:1782241615.148534:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120092544 00000100:00100000:3.0:1782241615.148587:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 115 00000100:00100000:3.0:1782241615.148596:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2395:x1868815120092544:12345-192.168.204.58@tcp:250:mount.lustre.0 00010000:00080000:3.0:1782241615.148624:0:22605:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 6596d410-35c6-4d46-bbb3-954c5be7798e@192.168.204.58@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1782241615.148798:0:22605:0:(genops.c:1406:class_connect()) connect: client 6596d410-35c6-4d46-bbb3-954c5be7798e, cookie 0xc9959f2fb1e1b63c 00000100:00080000:3.0:1782241615.149010:0:22605:0:(import.c:65:import_set_state_nolock()) ffff890d47a66000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241615.149882:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+5:2395:x1868815120092544:12345-192.168.204.58@tcp:250:mount.lustre.0 Request processed in 1280us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241615.149893:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 115 00000100:00100000:1.0:1782241615.177334:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241615.180866:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120092672 00000100:00100000:3.0:1782241615.180958:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120092672 00000100:00100000:3.0:1782241615.181184:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 116 00000100:00100000:3.0:1782241615.181198:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+5:18111:x1868815120092672:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782241615.181222:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241615.181245:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1b643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d3335056cf expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241615.181282:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1b643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056cf expref: 6 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241615.181296:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1b643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056cf expref: 6 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241615.181307:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb600, rc 0) 00000100:00100000:3.0:1782241615.181403:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+6:18111:x1868815120092672:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 209us (4087us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241615.181411:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 116 00000100:00100000:0.0:1782241615.189831:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241615.193288:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120092800 00000100:00100000:2.0:1782241615.193309:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120092800 00000100:00100000:2.0:1782241615.193401:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 117 00000100:00100000:2.0:1782241615.193413:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+6:18111:x1868815120092800:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782241615.198837:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+6:18111:x1868815120092800:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 5406us (9001us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782241615.198859:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 117 00000100:00100000:2.0:1782241615.203580:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241615.203852:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120092928 00000100:00100000:3.0:1782241615.203865:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120092928 00000100:00100000:3.0:1782241615.204038:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 118 00000100:00100000:3.0:1782241615.204050:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+6:18111:x1868815120092928:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782241615.204071:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241615.204108:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779ea200/0xc9959f2fb1e1b64a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d3335056d6 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241615.204162:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779ea200/0xc9959f2fb1e1b64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056d6 expref: 7 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241615.204174:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779ea200/0xc9959f2fb1e1b64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056d6 expref: 7 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241615.204186:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea200, rc 0) 00000100:00100000:3.0:1782241615.204255:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+7:18111:x1868815120092928:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 208us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241615.204264:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 118 00000100:00100000:0.0:1782241615.211314:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241615.211407:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120093056 00000100:00100000:1.0:1782241615.211419:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120093056 00000100:00100000:1.0:1782241615.211500:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 119 00000100:00100000:1.0:1782241615.211512:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4790bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+7:18111:x1868815120093056:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782241615.211747:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4790bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+8:18111:x1868815120093056:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 235us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241615.211779:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 119 00000100:00100000:0.0:1782241615.213927:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241615.214059:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120093184 00000100:00100000:3.0:1782241615.214071:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120093184 00000100:00100000:3.0:1782241615.214155:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 120 00000100:00100000:3.0:1782241615.214168:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+8:18111:x1868815120093184:12345-192.168.204.58@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782241615.214348:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+8:18111:x1868815120093184:12345-192.168.204.58@tcp:503:mount.lustre.0 Request processed in 182us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241615.214357:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 120 00000100:00100000:0.0:1782241615.217255:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241615.217382:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120093312 00000100:00100000:3.0:1782241615.217398:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120093312 00000100:00100000:3.0:1782241615.217557:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 121 00000100:00100000:3.0:1782241615.217569:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4790b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+8:18130:x1868815120093312:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782241615.217789:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4790b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+8:18130:x1868815120093312:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 190us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241615.217799:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 121 00000100:00100000:0.0:1782241615.259511:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241615.259842:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120093440 00000100:00100000:1.0:1782241615.259852:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120093440 00000100:00100000:1.0:1782241615.259910:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 122 00000100:00100000:1.0:1782241615.259921:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4790a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+8:18130:x1868815120093440:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782241615.260093:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4790a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+8:18130:x1868815120093440:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 173us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241615.260101:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 122 00000100:00100000:1.0:1782241615.272795:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241615.273035:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120093568 00000100:00100000:0.0:1782241615.273049:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120093568 00000100:00100000:0.0:1782241615.273123:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 123 00000100:00100000:0.0:1782241615.273136:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4790b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+8:18130:x1868815120093568:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782241615.273341:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4790b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+8:18130:x1868815120093568:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 206us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241615.273350:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 123 00000100:00100000:0.0:1782241615.285179:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241615.285273:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120093696 00000100:00100000:3.0:1782241615.285307:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120093696 00000100:00100000:3.0:1782241615.285380:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 124 00000100:00100000:3.0:1782241615.285392:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4790ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+8:18111:x1868815120093696:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782241615.285416:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241615.285440:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1b651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333505707 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241615.285487:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1b651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505707 expref: 9 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241615.285501:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1b651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505707 expref: 9 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241615.285512:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ebe00, rc 0) 00000100:00100000:3.0:1782241615.285597:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4790ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+9:18111:x1868815120093696:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 206us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241615.285606:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 124 00000100:00100000:0.0:1782241615.290040:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241615.290316:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120093824 00000100:00100000:1.0:1782241615.290328:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120093824 00000100:00100000:1.0:1782241615.290400:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 125 00000100:00100000:1.0:1782241615.290412:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+9:18111:x1868815120093824:12345-192.168.204.58@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782241615.290448:0:22605:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782241615.290490:0:22605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782241615.290494:0:22605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782241615.290498:0:22605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782241615.290500:0:22605:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1782241615.290502:0:22605:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1782241615.294122:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+9:18111:x1868815120093824:12345-192.168.204.58@tcp:256:mount.lustre.0 Request processed in 3695us (4080us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241615.294141:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 125 00000100:00100000:0.0:1782241615.299320:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241615.299542:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120093952 00000100:00100000:1.0:1782241615.299557:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120093952 00000100:00100000:1.0:1782241615.299632:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 126 00000100:00100000:1.0:1782241615.299707:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+9:18111:x1868815120093952:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782241615.299730:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241615.300129:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e7c311000/0xc9959f2fb1e1b658 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d33350570e expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241615.300172:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c311000/0xc9959f2fb1e1b658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350570e expref: 10 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241615.300185:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e7c311000/0xc9959f2fb1e1b658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350570e expref: 10 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241615.300196:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c311000, rc 0) 00000100:00100000:1.0:1782241615.300335:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+10:18111:x1868815120093952:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 692us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241615.300344:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 126 00000100:00100000:0.0:1782241615.308948:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241615.309284:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120094080 00000100:00100000:2.0:1782241615.309314:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120094080 00000100:00100000:2.0:1782241615.309392:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 127 00000100:00100000:2.0:1782241615.309404:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+10:18111:x1868815120094080:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782241615.309622:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+10:18111:x1868815120094080:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 219us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241615.309631:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 127 00000100:00100000:2.0:1782241615.312901:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241615.313603:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120094208 00000100:00100000:3.0:1782241615.313618:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120094208 00000100:00100000:3.0:1782241615.313705:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 128 00000100:00100000:3.0:1782241615.313717:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6d39e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+10:18111:x1868815120094208:12345-192.168.204.58@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782241615.313954:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6d39e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+10:18111:x1868815120094208:12345-192.168.204.58@tcp:503:mount.lustre.0 Request processed in 238us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241615.313963:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 128 00000100:00100000:0.0:1782241615.321090:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241615.321230:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120094336 00000100:00100000:1.0:1782241615.321243:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120094336 00000100:00100000:1.0:1782241615.321308:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 129 00000100:00100000:1.0:1782241615.321318:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+10:18136:x1868815120094336:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782241615.321701:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+10:18136:x1868815120094336:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 381us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241615.321711:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 129 00000100:00100000:0.0:1782241615.326707:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241615.327051:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120094464 00000100:00100000:2.0:1782241615.327067:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120094464 00000100:00100000:2.0:1782241615.327255:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 130 00000100:00100000:2.0:1782241615.327266:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+10:18136:x1868815120094464:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782241615.328165:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+10:18136:x1868815120094464:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 895us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241615.328178:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 130 00000100:00100000:2.0:1782241615.343595:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241615.343728:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241615.343966:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120094592 00000100:00100000:3.0:1782241615.343979:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120094592 00000100:00100000:3.0:1782241615.344025:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120094848 00000100:00100000:3.0:1782241615.344028:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120094848 00000100:00100000:3.0:1782241615.344084:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:3.0:1782241615.344095:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1868815120094592:12345-192.168.204.58@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782241615.344137:0:22612:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 5172bd8f-a514-4eaf-8b26-905e2daf8f5c@192.168.204.58@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1782241615.344210:0:22612:0:(genops.c:1406:class_connect()) connect: client 5172bd8f-a514-4eaf-8b26-905e2daf8f5c, cookie 0xc9959f2fb1e1b65f 00000004:00100000:3.0:1782241615.344245:0:22612:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782241615.344562:0:22612:0:(import.c:65:import_set_state_nolock()) ffff890d47a67800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241615.344657:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:2395:x1868815120094592:12345-192.168.204.58@tcp:38:mount.lustre.0 Request processed in 561us (8291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241615.344666:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:3.0:1782241615.344692:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:3.0:1782241615.344698:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1868815120094848:12345-192.168.204.58@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782241615.344717:0:22612:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 5172bd8f-a514-4eaf-8b26-905e2daf8f5c@192.168.204.58@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1782241615.344753:0:22612:0:(genops.c:1406:class_connect()) connect: client 5172bd8f-a514-4eaf-8b26-905e2daf8f5c, cookie 0xc9959f2fb1e1b666 00000004:00100000:3.0:1782241615.344809:0:22612:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782241615.344955:0:22612:0:(import.c:65:import_set_state_nolock()) ffff890e67fa1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241615.344981:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:2395:x1868815120094848:12345-192.168.204.58@tcp:38:mount.lustre.0 Request processed in 282us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241615.344989:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:0.0:1782241615.364236:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241615.364294:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241615.364392:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120094720 00000100:00100000:2.0:1782241615.364405:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120094720 00000100:00100000:2.0:1782241615.364503:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120094976 00000100:00100000:2.0:1782241615.364506:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120094976 00000100:00100000:2.0:1782241615.364534:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:2.0:1782241615.364545:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:0:x1868815120094720:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782241615.364600:0:22613:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782241615.364707:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:0:x1868815120094720:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 164us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241615.364714:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:2.0:1782241615.364741:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:2.0:1782241615.364747:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:0:x1868815120094976:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782241615.364819:0:22613:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782241615.364853:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:0:x1868815120094976:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 106us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241615.364859:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00080000:0.0:1782241615.365328:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241615.365334:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241615.373968:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241615.374140:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120095104 00000100:00100000:2.0:1782241615.374154:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120095104 00000100:00100000:2.0:1782241615.374224:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:2.0:1782241615.374235:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18111:x1868815120095104:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782241615.374277:0:22613:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782241615.374361:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18111:x1868815120095104:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 128us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241615.374369:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:2.0:1782241615.376312:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241615.376424:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120095232 00000100:00100000:1.0:1782241615.376436:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120095232 00000100:00100000:1.0:1782241615.376514:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:1.0:1782241615.376524:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18111:x1868815120095232:12345-192.168.204.58@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782241615.376631:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18111:x1868815120095232:12345-192.168.204.58@tcp:40:mount.lustre.0 Request processed in 107us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241615.376639:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:0.0:1782241615.379371:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241615.379417:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241615.379488:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241615.379591:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120095616 00000100:00100000:3.0:1782241615.379606:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120095616 00000100:00100000:3.0:1782241615.379688:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:3.0:1782241615.379700:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18111:x1868815120095616:12345-192.168.204.58@tcp:900:mount.lustre.0 00000100:00100000:3.0:1782241615.379849:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18111:x1868815120095616:12345-192.168.204.58@tcp:900:mount.lustre.0 Request processed in 151us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241615.379858:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:1.0:1782241615.380134:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120095360 00000100:00100000:1.0:1782241615.380140:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120095360 00000100:00100000:1.0:1782241615.380171:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120095488 00000100:00100000:1.0:1782241615.380174:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120095488 00000100:00100000:1.0:1782241615.380192:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:1.0:1782241615.380198:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1868815120095360:12345-192.168.204.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782241615.380232:0:24125:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 5172bd8f-a514-4eaf-8b26-905e2daf8f5c@192.168.204.58@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:1.0:1782241615.380272:0:24125:0:(genops.c:1406:class_connect()) connect: client 5172bd8f-a514-4eaf-8b26-905e2daf8f5c, cookie 0xc9959f2fb1e1b66d 00002000:00100000:1.0:1782241615.380287:0:24125:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5172bd8f-a514-4eaf-8b26-905e2daf8f5c/ffff890e7cb7a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782241615.380314:0:24125:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782241615.380549:0:24125:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782241615.380589:0:24125:0:(import.c:65:import_set_state_nolock()) ffff890e7cb7c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241615.380635:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:2395:x1868815120095360:12345-192.168.204.58@tcp:8:mount.lustre.0 Request processed in 436us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241615.380643:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:1.0:1782241615.380657:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:1.0:1782241615.380662:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1868815120095488:12345-192.168.204.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782241615.380678:0:24125:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 5172bd8f-a514-4eaf-8b26-905e2daf8f5c@192.168.204.58@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:1.0:1782241615.380694:0:24125:0:(genops.c:1406:class_connect()) connect: client 5172bd8f-a514-4eaf-8b26-905e2daf8f5c, cookie 0xc9959f2fb1e1b674 00002000:00100000:1.0:1782241615.380699:0:24125:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5172bd8f-a514-4eaf-8b26-905e2daf8f5c/ffff890e7cb78800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782241615.380711:0:24125:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782241615.380842:0:24125:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782241615.380856:0:24125:0:(import.c:65:import_set_state_nolock()) ffff890e7cb7e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241615.380877:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:2395:x1868815120095488:12345-192.168.204.58@tcp:8:mount.lustre.0 Request processed in 214us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241615.381646:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:0.0:1782241615.391430:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241615.391703:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120095744 00000100:00100000:1.0:1782241615.391717:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120095744 00000100:00100000:1.0:1782241615.392180:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:1.0:1782241615.392194:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18111:x1868815120095744:12345-192.168.204.58@tcp:33:mount.lustre.0 00000004:00080000:2.0:1782241615.394114:0:22614:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1797us 00000004:00200000:0.0:1782241615.424063:0:22614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782241615.424263:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18111:x1868815120095744:12345-192.168.204.58@tcp:33:mount.lustre.0 Request processed in 32064us (32900us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241615.424281:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 0 00010000:00010000:0.0:1782241615.621990:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241615.719358:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241615.719501:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120095872 00000100:00100000:2.0:1782241615.719513:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120095872 00000100:00100000:2.0:1782241615.719599:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:2.0:1782241615.719611:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18158:x1868815120095872:12345-192.168.204.58@tcp:101:mkdir.0 00010000:00010000:2.0:1782241615.719648:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241615.727380:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b67b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350573f expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241615.727481:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b682 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241615.727510:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241615.727528:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241615.727588:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782241615.727591:0:22613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241615.727640:0:22613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241615.727668:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b67b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350573f expref: 8 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241615.727691:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b682 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350573f expref: 7 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241615.727700:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4781d000) 00010000:00010000:2.0:1782241615.727703:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782241615.727706:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad200, rc 0) 00000100:00100000:2.0:1782241615.727821:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:18158:x1868815120095872:12345-192.168.204.58@tcp:101:mkdir.0 Request processed in 8211us (8479us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241615.727830:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:0.0:1782241616.133169:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140127488:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.133260:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241616.133267:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140127744:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.133342:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140128000:0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.133354:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241616.133390:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241616.133394:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140128256:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.133426:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140128512:0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.133436:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241616.133483:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241616.133505:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140128768:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.133514:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782241616.133526:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140127616:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.133564:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241616.133582:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140128128:0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.133593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241616.133632:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1782241616.133639:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241616.133646:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140127360:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.133665:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140128640:0@lo:400:kworker.0 00000100:00100000:3.0:1782241616.133810:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140127744 00000100:00100000:3.0:1782241616.133822:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140127744 00000100:00100000:3.0:1782241616.133883:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140128256 00000100:00100000:3.0:1782241616.133887:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140128256 00000100:00100000:3.0:1782241616.133904:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140127616 00000100:00100000:3.0:1782241616.133907:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140127616 00000100:00100000:3.0:1782241616.133920:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140128128 00000100:00100000:3.0:1782241616.133923:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140128128 00000100:00100000:3.0:1782241616.133943:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782241616.133953:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140127744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241616.134140:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140128512 00000100:00100000:1.0:1782241616.134147:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140128512 00000100:00100000:1.0:1782241616.134197:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140128768 00000100:00100000:1.0:1782241616.134201:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140128768 00000100:00100000:1.0:1782241616.134230:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782241616.134239:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140128512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.134345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241616.134371:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140129024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241616.134394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241616.134439:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140127488 00000100:00100000:0.0:1782241616.134442:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140127488 00000100:00100000:0.0:1782241616.134816:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140128000 00000100:00100000:0.0:1782241616.134821:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140128000 00000100:00100000:0.0:1782241616.134838:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782241616.134844:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140127488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.134886:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140127488:12345-0@lo:400:kworker.0 Request processed in 41us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241616.134893:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782241616.134910:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782241616.134916:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140128000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.134942:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140128000:12345-0@lo:400:kworker.0 Request processed in 27us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241616.134947:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782241616.134968:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140129024 00000100:00100000:0.0:1782241616.134972:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140129024 00000100:00100000:0.0:1782241616.134995:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241616.135000:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1868815140129024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241616.135015:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782241616.135043:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1868815140129024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241616.135049:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1782241616.135071:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241616.135076:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241616.135079:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782241616.135088:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140128640 00000100:00100000:0.0:1782241616.135098:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140128640 00000100:00100000:0.0:1782241616.135121:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782241616.135127:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140128768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.135158:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140128768:12345-0@lo:400:kworker.0 Request processed in 31us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241616.135165:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782241616.135176:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782241616.135182:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140128640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.135208:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140128640:12345-0@lo:400:kworker.0 Request processed in 27us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241616.135214:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1782241616.135226:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241616.135257:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140129024:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1782241616.135270:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47830e00 x1868815140128640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241616.135280:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140128640:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.135290:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140128000:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.135299:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140127488:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.135359:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241616.135367:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140128256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.135398:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140128256:12345-0@lo:400:kworker.0 Request processed in 33us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241616.135403:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241616.135419:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241616.135434:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140127616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.135479:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140127616:12345-0@lo:400:kworker.0 Request processed in 47us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241616.135485:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241616.135497:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241616.135503:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140128128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.135528:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140128128:12345-0@lo:400:kworker.0 Request processed in 25us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241616.135533:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241616.135561:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140127616:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.135570:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140128128:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.135638:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140129152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241616.135665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241616.135688:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140129152 00000100:00100000:0.0:1782241616.135692:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140129152 00000100:00100000:0.0:1782241616.135710:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782241616.135715:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140129152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241616.135725:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782241616.135750:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140129152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241616.135780:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782241616.135808:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140129152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241616.140599:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241616.140719:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140127872:0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.140818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241616.140842:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140128384:0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.140865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241616.140884:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140128896:0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.140911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241616.140958:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140128256:0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.140974:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140128768:0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.141150:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140127872 00000100:00100000:2.0:1782241616.141158:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140127872 00000100:00100000:2.0:1782241616.141319:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140128384 00000100:00100000:2.0:1782241616.141323:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140128384 00000100:00100000:2.0:1782241616.141335:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140128896 00000100:00100000:2.0:1782241616.141337:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140128896 00000100:00100000:2.0:1782241616.141367:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782241616.141376:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140127872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.141443:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140127872:12345-0@lo:400:kworker.0 Request processed in 67us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241616.141462:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782241616.141480:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782241616.141485:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140128384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.141530:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140128384:12345-0@lo:400:kworker.0 Request processed in 44us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241616.141537:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782241616.141549:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782241616.141791:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140128896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241616.141801:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140127360 00000100:00100000:1.0:1782241616.141818:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140127360 00000100:00100000:1.0:1782241616.141897:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1782241616.141909:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3639:x1868815140127360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241616.145609:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140127744:12345-0@lo:400:kworker.0 Request processed in 11640us (12244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241616.145630:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241616.146367:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140128896:12345-0@lo:400:kworker.0 Request processed in 4575us (5448us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241616.146381:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1782241616.146420:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241616.146500:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140127872:0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.146518:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140128384:0@lo:400:kworker.0 00010000:00080000:2.0:1782241616.146532:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47833800 x1868815140128896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241616.146542:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140128896:0@lo:400:kworker.0 00000100:00100000:2.0:1782241616.146558:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140127744:0@lo:400:kworker.0 00000100:00100000:1.0:1782241616.150652:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3639:x1868815140127360:12345-0@lo:400:kworker.0 Request processed in 8246us (9564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241616.150668:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782241616.151135:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140127360:0@lo:400:kworker.0 00000100:00100000:0.0:1782241616.152969:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140128512:12345-0@lo:400:kworker.0 Request processed in 18717us (19473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241616.153027:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782241616.153406:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140128512:0@lo:400:kworker.0 00000100:00100000:3.0:1782241616.645569:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140129280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241616.645661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241616.646047:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140129280 00000100:00100000:0.0:1782241616.646056:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140129280 00000100:00100000:0.0:1782241616.646120:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782241616.646130:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140129280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241616.646154:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1782241616.646203:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140129280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241616.646211:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1782241616.646872:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241616.647461:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140129280:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1782241616.656518:0:24940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5172bd8f-a514-4eaf-8b26-905e2daf8f5c 00000001:00080000:2.0:1782241616.656541:0:24940:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1782241617.669315:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241617.670626:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241617.670659:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140129408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241617.670800:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241617.670930:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140129408 00000100:00100000:0.0:1782241617.670941:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140129408 00000100:00100000:0.0:1782241617.671014:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782241617.671026:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140129408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241617.671072:0:23684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1782241617.671131:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140129408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241617.671150:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241617.671306:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140129408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241617.674567:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241617.674599:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140129536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241617.674693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241617.675535:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140129536 00000100:00100000:2.0:1782241617.675548:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140129536 00000100:00100000:2.0:1782241617.675629:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782241617.675659:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140129536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782241617.675706:0:22617:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782241617.675817:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140129536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241617.675826:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782241617.675998:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140129536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241617.955933:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241617.956134:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120096000 00000100:00100000:2.0:1782241617.956157:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120096000 00000100:00100000:2.0:1782241617.956261:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:2.0:1782241617.956279:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:18211:x1868815120096000:12345-192.168.204.58@tcp:41:lfs.0 00000004:00000024:2.0:1782241617.956337:0:24571:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782241617.956459:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:18211:x1868815120096000:12345-192.168.204.58@tcp:41:lfs.0 Request processed in 182us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241617.956467:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00080000:3.0:1782241617.959737:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241617.960036:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241617.960254:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120096128 00000100:00100000:2.0:1782241617.960267:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120096128 00000100:00100000:2.0:1782241617.960404:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:2.0:1782241617.960427:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18211:x1868815120096128:12345-192.168.204.58@tcp:41:lfs.0 00000004:00000024:2.0:1782241617.960482:0:22613:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782241617.960650:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18211:x1868815120096128:12345-192.168.204.58@tcp:41:lfs.0 Request processed in 235us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241617.960659:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00080000:3.0:1782241617.963615:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241617.974194:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241617.974988:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120096256 00000100:00100000:0.0:1782241617.975004:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120096256 00000100:00100000:0.0:1782241617.975173:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:0.0:1782241617.975187:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18211:x1868815120096256:12345-192.168.204.58@tcp:13:lfs.0 00002000:00000024:0.0:1782241617.975236:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1782241617.975358:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18211:x1868815120096256:12345-192.168.204.58@tcp:13:lfs.0 Request processed in 175us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241617.975368:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00080000:3.0:1782241617.980438:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241617.986286:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241617.986430:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120096384 00000100:00100000:0.0:1782241617.986443:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120096384 00000100:00100000:0.0:1782241617.986738:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:0.0:1782241617.986753:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:18211:x1868815120096384:12345-192.168.204.58@tcp:13:lfs.0 00002000:00000024:0.0:1782241617.986873:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782241617.986992:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:18211:x1868815120096384:12345-192.168.204.58@tcp:13:lfs.0 Request processed in 243us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241617.987001:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00080000:3.0:1782241617.992502:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241618.150244:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241618.150840:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120096512 00000100:00100000:1.0:1782241618.150853:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120096512 00000100:00100000:1.0:1782241618.150926:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 132 00000100:00100000:1.0:1782241618.150938:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+10:18240:x1868815120096512:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782241618.150960:0:22605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241618.150985:0:22605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333505746 expref: -99 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241618.151023:0:22605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505746 expref: 11 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241618.151036:0:22605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e7c311200/0xc9959f2fb1e1b689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505746 expref: 11 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241618.151065:0:22605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c311200, rc 0) 00000100:00100000:1.0:1782241618.151170:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18240:x1868815120096512:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 233us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241618.151178:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 132 00000100:00100000:2.0:1782241618.157021:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241618.157201:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120096640 00000100:00100000:1.0:1782241618.157215:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120096640 00000100:00100000:1.0:1782241618.157364:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 133 00000100:00100000:1.0:1782241618.157378:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18240:x1868815120096640:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782241618.157956:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18240:x1868815120096640:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 580us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241618.157968:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 133 00000100:00100000:2.0:1782241618.164654:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241618.164927:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120096768 00000100:00100000:3.0:1782241618.164941:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120096768 00000100:00100000:3.0:1782241618.165071:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 134 00000100:00100000:3.0:1782241618.165090:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18240:x1868815120096768:12345-192.168.204.58@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782241618.165375:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18240:x1868815120096768:12345-192.168.204.58@tcp:503:mount.lustre.0 Request processed in 287us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241618.165384:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 134 00000100:00100000:3.0:1782241618.187426:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241618.187624:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120096896 00000100:00100000:1.0:1782241618.187638:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120096896 00000100:00100000:1.0:1782241618.187729:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 135 00000100:00100000:1.0:1782241618.187743:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18250:x1868815120096896:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782241618.188009:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18250:x1868815120096896:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 268us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241618.188018:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 135 00000100:00100000:1.0:1782241618.222060:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241618.222934:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120097024 00000100:00100000:3.0:1782241618.222950:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120097024 00000100:00100000:3.0:1782241618.223044:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 136 00000100:00100000:3.0:1782241618.223057:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18250:x1868815120097024:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782241618.223377:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18250:x1868815120097024:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 321us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241618.223387:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 136 00000100:00100000:0.0:1782241618.230898:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241618.231750:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120097152 00000100:00100000:2.0:1782241618.231808:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120097152 00000100:00100000:2.0:1782241618.231905:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 137 00000100:00100000:2.0:1782241618.231938:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18250:x1868815120097152:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782241618.232315:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18250:x1868815120097152:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 378us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241618.232326:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 137 00000100:00100000:0.0:1782241618.239123:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241618.240452:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120097280 00000100:00100000:1.0:1782241618.240502:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120097280 00000100:00100000:1.0:1782241618.240606:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 138 00000100:00100000:1.0:1782241618.240620:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18240:x1868815120097280:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782241618.240646:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241618.240933:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333505777 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241618.240973:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505777 expref: 12 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241618.240986:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e7c310600/0xc9959f2fb1e1b690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505777 expref: 12 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241618.240997:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c310600, rc 0) 00000100:00100000:1.0:1782241618.241211:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+12:18240:x1868815120097280:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 593us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241618.241221:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 138 00000100:00100000:1.0:1782241618.245196:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241618.245437:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120097408 00000100:00100000:3.0:1782241618.245451:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120097408 00000100:00100000:3.0:1782241618.245630:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 139 00000100:00100000:3.0:1782241618.245646:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+12:18240:x1868815120097408:12345-192.168.204.58@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782241618.245691:0:22604:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782241618.245726:0:22604:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782241618.245731:0:22604:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782241618.245734:0:22604:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782241618.245737:0:22604:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1782241618.245739:0:22604:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1782241618.248023:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+12:18240:x1868815120097408:12345-192.168.204.58@tcp:256:mount.lustre.0 Request processed in 2366us (2935us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241618.248041:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 139 00000100:00100000:0.0:1782241618.253243:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241618.265571:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120097536 00000100:00100000:2.0:1782241618.265596:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120097536 00000100:00100000:2.0:1782241618.265709:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 140 00000100:00100000:2.0:1782241618.265722:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+12:18240:x1868815120097536:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782241618.265747:0:22605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241618.265822:0:22605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e43fadc00/0xc9959f2fb1e1b697 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d33350577e expref: -99 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241618.265873:0:22605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43fadc00/0xc9959f2fb1e1b697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350577e expref: 13 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241618.265887:0:22605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e43fadc00/0xc9959f2fb1e1b697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350577e expref: 13 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241618.265898:0:22605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fadc00, rc 0) 00000100:00100000:2.0:1782241618.265978:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18240:x1868815120097536:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 259us (12753us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241618.265987:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 140 00000100:00100000:2.0:1782241618.272090:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241618.272906:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120097664 00000100:00100000:3.0:1782241618.272923:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120097664 00000100:00100000:3.0:1782241618.273004:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 141 00000100:00100000:3.0:1782241618.273017:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18240:x1868815120097664:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782241618.273385:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18240:x1868815120097664:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 369us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241618.273395:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 141 00000100:00100000:0.0:1782241618.275704:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241618.278158:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120097792 00000100:00100000:1.0:1782241618.278180:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120097792 00000100:00100000:0.0:1782241618.278483:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 142 00000100:00100000:0.0:1782241618.278497:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18240:x1868815120097792:12345-192.168.204.58@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782241618.278856:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18240:x1868815120097792:12345-192.168.204.58@tcp:503:mount.lustre.0 Request processed in 355us (3284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241618.278866:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 142 00000100:00100000:0.0:1782241618.288198:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241618.288302:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120097920 00000100:00100000:3.0:1782241618.288317:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120097920 00000100:00100000:3.0:1782241618.288390:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 143 00000100:00100000:3.0:1782241618.288402:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18256:x1868815120097920:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782241618.288820:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18256:x1868815120097920:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 418us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241618.288842:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 143 00000100:00100000:1.0:1782241618.296000:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241618.296176:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120098048 00000100:00100000:0.0:1782241618.296190:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120098048 00000100:00100000:0.0:1782241618.296266:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 144 00000100:00100000:0.0:1782241618.296279:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18256:x1868815120098048:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782241618.296535:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18256:x1868815120098048:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 258us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241618.296546:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 144 00000100:00100000:0.0:1782241618.302454:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241618.303127:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120098176 00000100:00100000:2.0:1782241618.303144:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120098176 00000100:00100000:2.0:1782241618.303224:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:2.0:1782241618.303237:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1868815120098176:12345-192.168.204.58@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782241618.303325:0:24571:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7ba7844f-6088-459d-bcca-a5136f4f097b@192.168.204.58@tcp t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:2.0:1782241618.303378:0:24571:0:(genops.c:1406:class_connect()) connect: client 7ba7844f-6088-459d-bcca-a5136f4f097b, cookie 0xc9959f2fb1e1b69e 00000004:00100000:2.0:1782241618.303424:0:24571:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782241618.303564:0:24571:0:(import.c:65:import_set_state_nolock()) ffff890e7cbd5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241618.303672:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2395:x1868815120098176:12345-192.168.204.58@tcp:38:mount.lustre.0 Request processed in 436us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241618.303681:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:0.0:1782241618.303859:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241618.304087:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120098432 00000100:00100000:3.0:1782241618.304094:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120098432 00000100:00100000:3.0:1782241618.304131:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:3.0:1782241618.304136:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1868815120098432:12345-192.168.204.58@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782241618.304159:0:22612:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 7ba7844f-6088-459d-bcca-a5136f4f097b@192.168.204.58@tcp t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:3.0:1782241618.304196:0:22612:0:(genops.c:1406:class_connect()) connect: client 7ba7844f-6088-459d-bcca-a5136f4f097b, cookie 0xc9959f2fb1e1b6a5 00000004:00100000:3.0:1782241618.304216:0:22612:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782241618.304280:0:22612:0:(import.c:65:import_set_state_nolock()) ffff890e449fa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241618.304323:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2395:x1868815120098432:12345-192.168.204.58@tcp:38:mount.lustre.0 Request processed in 184us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241618.304331:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:0.0:1782241618.312104:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241618.312165:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241618.312276:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120098304 00000100:00100000:2.0:1782241618.312290:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120098304 00000100:00100000:2.0:1782241618.312394:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120098688 00000100:00100000:2.0:1782241618.312398:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120098688 00000100:00100000:2.0:1782241618.312436:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:2.0:1782241618.312449:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+7:0:x1868815120098304:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782241618.312502:0:24571:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782241618.312652:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+7:0:x1868815120098304:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 205us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241618.312662:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:2.0:1782241618.312687:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:2.0:1782241618.312694:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+6:18240:x1868815120098688:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782241618.312708:0:24571:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782241618.312813:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+6:18240:x1868815120098688:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 119us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241618.312821:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00080000:0.0:1782241618.313117:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241618.317272:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241618.317453:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120098560 00000100:00100000:2.0:1782241618.317468:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120098560 00000100:00100000:2.0:1782241618.317651:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:2.0:1782241618.317665:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+6:0:x1868815120098560:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782241618.317709:0:24571:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782241618.317878:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+6:0:x1868815120098560:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 216us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241618.317887:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00080000:0.0:1782241618.318238:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241618.318968:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241618.319053:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120098816 00000100:00100000:1.0:1782241618.319063:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120098816 00000100:00100000:1.0:1782241618.319311:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:1.0:1782241618.319322:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ba7844f-6088-459d-bcca-a5136f4f097b+6:18240:x1868815120098816:12345-192.168.204.58@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782241618.319423:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ba7844f-6088-459d-bcca-a5136f4f097b+6:18240:x1868815120098816:12345-192.168.204.58@tcp:40:mount.lustre.0 Request processed in 103us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241618.319431:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:1.0:1782241618.367042:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241618.367121:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241618.367162:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241618.367352:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120098944 00000100:00100000:2.0:1782241618.367365:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120098944 00000100:00100000:2.0:1782241618.367420:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120099072 00000100:00100000:2.0:1782241618.367424:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120099072 00000100:00100000:2.0:1782241618.367446:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:2.0:1782241618.367457:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1868815120098944:12345-192.168.204.58@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782241618.367502:0:24125:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7ba7844f-6088-459d-bcca-a5136f4f097b@192.168.204.58@tcp t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:2.0:1782241618.367543:0:24125:0:(genops.c:1406:class_connect()) connect: client 7ba7844f-6088-459d-bcca-a5136f4f097b, cookie 0xc9959f2fb1e1b6ac 00002000:00100000:2.0:1782241618.367563:0:24125:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7ba7844f-6088-459d-bcca-a5136f4f097b/ffff890e7cbd6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782241618.367582:0:24125:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782241618.367680:0:24125:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782241618.367721:0:24125:0:(import.c:65:import_set_state_nolock()) ffff890e7cbd5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241618.367854:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2395:x1868815120098944:12345-192.168.204.58@tcp:8:mount.lustre.0 Request processed in 397us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241618.367862:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:2.0:1782241618.367884:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:2.0:1782241618.367889:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1868815120099072:12345-192.168.204.58@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782241618.367908:0:24125:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7ba7844f-6088-459d-bcca-a5136f4f097b@192.168.204.58@tcp t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:2.0:1782241618.367926:0:24125:0:(genops.c:1406:class_connect()) connect: client 7ba7844f-6088-459d-bcca-a5136f4f097b, cookie 0xc9959f2fb1e1b6b3 00002000:00100000:2.0:1782241618.367941:0:24125:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7ba7844f-6088-459d-bcca-a5136f4f097b/ffff890e7cbd2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782241618.367949:0:24125:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782241618.368002:0:24125:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782241618.368018:0:24125:0:(import.c:65:import_set_state_nolock()) ffff890e7cbd4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241618.368043:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2395:x1868815120099072:12345-192.168.204.58@tcp:8:mount.lustre.0 Request processed in 153us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241618.368050:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:3.0:1782241618.368157:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120099200 00000100:00100000:3.0:1782241618.368163:0:22622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120099200 00000100:00100000:3.0:1782241618.368221:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:3.0:1782241618.368241:0:22622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7ba7844f-6088-459d-bcca-a5136f4f097b+6:18240:x1868815120099200:12345-192.168.204.58@tcp:900:mount.lustre.0 00000100:00100000:3.0:1782241618.368282:0:22622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7ba7844f-6088-459d-bcca-a5136f4f097b+6:18240:x1868815120099200:12345-192.168.204.58@tcp:900:mount.lustre.0 Request processed in 54us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241618.368289:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:2.0:1782241618.374168:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241618.374375:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120099328 00000100:00100000:3.0:1782241618.374389:0:22615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120099328 00000100:00100000:3.0:1782241618.374474:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 1 00000100:00100000:3.0:1782241618.374489:0:22615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+6:18240:x1868815120099328:12345-192.168.204.58@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782241618.375019:0:22615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1782241618.376743:0:22615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+6:18240:x1868815120099328:12345-192.168.204.58@tcp:33:mount.lustre.0 Request processed in 1582us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241618.376796:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 1 00000100:00100000:0.0:1782241618.611479:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241618.612037:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120099456 00000100:00100000:2.0:1782241618.612063:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120099456 00000100:00100000:2.0:1782241618.612149:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:2.0:1782241618.612161:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+6:18279:x1868815120099456:12345-192.168.204.58@tcp:101:mkdir.0 00010000:00010000:2.0:1782241618.612201:0:24571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241618.612395:0:24571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1b6ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057af expref: -99 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241618.612502:0:24571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241618.612520:0:24571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241618.612536:0:24571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241618.612611:0:24571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782241618.612616:0:24571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241618.612962:0:24571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241618.613029:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1b6ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057af expref: 8 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241618.613432:0:24571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057af expref: 7 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241618.613445:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4781d000) 00010000:00010000:2.0:1782241618.613448:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782241618.613453:0:24571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43faca00, rc 0) 00000100:00100000:2.0:1782241618.613615:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+7:18279:x1868815120099456:12345-192.168.204.58@tcp:101:mkdir.0 Request processed in 1454us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241618.613635:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 22 00010000:00010000:0.0:1782241618.693597:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241618.693869:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140129664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782241618.693975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241618.694157:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140129664 00000100:00100000:0.0:1782241618.694168:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140129664 00000100:00100000:0.0:1782241618.694265:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782241618.694279:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140129664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241618.694314:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1782241618.694378:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140129664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241618.694386:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782241618.694462:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140129664:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782241618.694617:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1782241619.141514:0:22647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782241619.718061:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241620.742528:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782241620.743984:0:24119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7ba7844f-6088-459d-bcca-a5136f4f097b 00000001:00100000:1.0:1782241620.743996:0:24119:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5172bd8f-a514-4eaf-8b26-905e2daf8f5c 00000001:00100000:2.0:1782241620.747347:0:22592:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7ba7844f-6088-459d-bcca-a5136f4f097b 00000001:00100000:2.0:1782241620.747423:0:22592:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5172bd8f-a514-4eaf-8b26-905e2daf8f5c 00000001:00100000:0.0:1782241620.754963:0:23345:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7ba7844f-6088-459d-bcca-a5136f4f097b 00000001:00100000:0.0:1782241620.754976:0:23345:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5172bd8f-a514-4eaf-8b26-905e2daf8f5c 00000100:00100000:0.0:1782241621.253378:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241621.253408:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140129792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241621.253489:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241621.253560:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140129792 00000100:00100000:0.0:1782241621.253569:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140129792 00000100:00100000:0.0:1782241621.253636:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782241621.253646:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140129792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241621.253690:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782241621.253736:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140129792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241621.253744:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1782241621.253784:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782241621.254142:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140129792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241621.254163:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140129920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241621.254192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241621.254467:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140130048:0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.254504:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241621.254524:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140130560:0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.254552:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241621.254578:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140131072:0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.254616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241621.254635:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782241621.254641:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140130176:0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.254662:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241621.254680:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140130688:0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.254699:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241621.254715:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815140131200:0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.254735:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241621.254787:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140130560 00000100:00100000:1.0:1782241621.254792:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140130560 00000100:00100000:1.0:1782241621.254832:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140130176 00000100:00100000:1.0:1782241621.254835:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140130176 00000100:00100000:1.0:1782241621.254851:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782241621.254857:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140130560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.254902:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140130560:12345-0@lo:400:kworker.0 Request processed in 45us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241621.254909:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782241621.254923:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782241621.254941:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140130176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.254971:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140130176:12345-0@lo:400:kworker.0 Request processed in 31us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241621.254977:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782241621.254994:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140131072 00000100:00100000:1.0:1782241621.254998:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140131072 00000100:00100000:1.0:1782241621.255025:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140131200 00000100:00100000:1.0:1782241621.255028:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140131200 00000100:00100000:1.0:1782241621.255047:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782241621.255053:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140131072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.255084:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140131072:12345-0@lo:400:kworker.0 Request processed in 31us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241621.255090:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782241621.255101:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782241621.255107:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815140131200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.255132:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815140131200:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241621.255137:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782241621.255164:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140130176:0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.255175:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815140131200:0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.255183:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140130560:0@lo:400:kworker.0 00010000:00080000:1.0:1782241621.255194:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4881b100 x1868815140131072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241621.255204:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140131072:0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.255259:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140130688 00000100:00100000:1.0:1782241621.255263:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140130688 00000100:00100000:1.0:1782241621.255292:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241621.255299:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140130688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241621.255335:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140130688:12345-0@lo:400:kworker.0 Request processed in 36us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241621.255341:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241621.255377:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140130688:0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.255628:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140130304:0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.255660:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241621.255679:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140130816:0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.255698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241621.255713:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140131328:0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.255735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241621.255751:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782241621.255797:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140130432:0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.255829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241621.255848:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140130944:0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.255869:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241621.255891:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140130048 00000100:00100000:3.0:1782241621.255895:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140130048 00000100:00100000:3.0:1782241621.255927:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782241621.255933:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3637:x1868815140130048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.255969:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3637:x1868815140130048:12345-0@lo:400:kworker.0 Request processed in 35us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241621.255976:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782241621.256003:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140130816 00000100:00100000:3.0:1782241621.256007:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140130816 00000100:00100000:3.0:1782241621.256022:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140131328 00000100:00100000:3.0:1782241621.256023:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140131328 00000100:00100000:3.0:1782241621.256035:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140130432 00000100:00100000:3.0:1782241621.256038:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140130432 00000100:00100000:3.0:1782241621.256048:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140130944 00000100:00100000:3.0:1782241621.256051:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140130944 00000100:00100000:3.0:1782241621.256066:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782241621.256071:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140130816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.256104:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140130816:12345-0@lo:400:kworker.0 Request processed in 31us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241621.256109:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782241621.256121:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782241621.256127:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140131328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.256371:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140131328:12345-0@lo:400:kworker.0 Request processed in 244us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241621.256377:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782241621.256390:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241621.256402:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140130432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.256428:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140130432:12345-0@lo:400:kworker.0 Request processed in 27us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241621.256433:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241621.256445:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782241621.256451:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140130944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.256474:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140130944:12345-0@lo:400:kworker.0 Request processed in 23us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241621.256479:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782241621.256500:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140130304 00000100:00100000:3.0:1782241621.256503:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140130304 00000100:00100000:3.0:1782241621.256529:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782241621.256535:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140130304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.256563:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140130304:12345-0@lo:400:kworker.0 Request processed in 28us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241621.256569:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782241621.256602:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140130432:0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.256611:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140130944:0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.256619:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140130304:0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.256627:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140130816:0@lo:400:kworker.0 00010000:00080000:3.0:1782241621.256637:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793df80 x1868815140131328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241621.256646:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140131328:0@lo:400:kworker.0 00000100:00100000:3.0:1782241621.256690:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140130048:0@lo:400:kworker.0 00000100:00080000:0.0:1782241621.257427:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241621.257435:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241621.257438:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241621.261819:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140129920 00000100:00100000:2.0:1782241621.261834:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140129920 00000100:00100000:2.0:1782241621.261919:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241621.261931:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140129920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782241621.261957:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241621.262035:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140129920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (7842us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241621.262042:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1782241621.262200:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782241621.262238:0:3640:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1782241621.262264:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140129920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782241621.765152:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241621.769526:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140131456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241621.769621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241621.769902:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140131456 00000100:00100000:0.0:1782241621.769911:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140131456 00000100:00100000:0.0:1782241621.769968:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782241621.769978:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140131456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241621.770016:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1782241621.770081:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140131456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241621.770098:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782241621.770499:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140131456:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1782241622.350636:0:25497:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1782241622.789057:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140131584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241622.789134:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241622.789238:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140131584 00000100:00100000:0.0:1782241622.789245:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140131584 00000100:00100000:0.0:1782241622.789298:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782241622.789307:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140131584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241622.789371:0:22616:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1782241622.789431:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140131584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241622.789439:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782241622.789528:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140131584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241622.789741:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241622.789750:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140131712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241622.789796:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241622.789866:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140131712 00000100:00100000:0.0:1782241622.789871:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140131712 00000100:00100000:0.0:1782241622.789902:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782241622.789908:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140131712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241622.789926:0:23684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782241622.789959:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140131712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241622.789965:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782241622.790033:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140131712:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782241622.790236:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241623.451191:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241623.451236:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241623.451263:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241623.451285:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241623.451314:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241623.451336:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241623.451354:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241623.451371:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241623.451394:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241623.451421:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120099840 00000100:00100000:3.0:1782241623.451430:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120099840 00000100:00100000:3.0:1782241623.451500:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120100352 00000100:00100000:3.0:1782241623.451504:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120100352 00000100:00100000:3.0:1782241623.451518:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120099712 00000100:00100000:3.0:1782241623.451520:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120099712 00000100:00100000:3.0:1782241623.451532:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120100224 00000100:00100000:3.0:1782241623.451534:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120100224 00000100:00100000:3.0:1782241623.451550:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 48 00000100:00100000:3.0:1782241623.451576:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2396:x1868815120099840:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241623.451656:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2396:x1868815120099840:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 84us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241623.451664:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 48 00000100:00100000:3.0:1782241623.451685:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 49 00000100:00100000:3.0:1782241623.451691:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2396:x1868815120100352:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241623.451716:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2396:x1868815120100352:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241623.451722:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 49 00000100:00100000:3.0:1782241623.451735:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:3.0:1782241623.451742:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:2396:x1868815120099712:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241623.451789:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:2396:x1868815120099712:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 47us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241623.451795:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:3.0:1782241623.451806:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 51 00000100:00100000:3.0:1782241623.451812:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2396:x1868815120100224:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241623.451834:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2396:x1868815120100224:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 22us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241623.451840:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 51 00000100:00100000:3.0:1782241623.451858:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120100096 00000100:00100000:3.0:1782241623.451861:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120100096 00000100:00100000:3.0:1782241623.451880:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120100608 00000100:00100000:3.0:1782241623.451882:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120100608 00000100:00100000:3.0:1782241623.451892:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120099968 00000100:00100000:3.0:1782241623.451900:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120099968 00000100:00100000:3.0:1782241623.451914:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120100480 00000100:00100000:3.0:1782241623.451917:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120100480 00000100:00100000:3.0:1782241623.451929:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:3.0:1782241623.451934:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2396:x1868815120100096:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241623.451959:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2396:x1868815120100096:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241623.451965:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:3.0:1782241623.451976:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:3.0:1782241623.451981:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2396:x1868815120100608:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241623.452021:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2396:x1868815120100608:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 39us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241623.452028:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:3.0:1782241623.452040:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:3.0:1782241623.452047:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2396:x1868815120099968:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241623.452070:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2396:x1868815120099968:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 24us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241623.452076:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:3.0:1782241623.452086:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:3.0:1782241623.452092:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2396:x1868815120100480:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241623.452113:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2396:x1868815120100480:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 21us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241623.452119:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:0.0:1782241623.453604:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120099584 00000100:00100000:0.0:1782241623.453616:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120099584 00000100:00100000:0.0:1782241623.453666:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 146 00000100:00100000:0.0:1782241623.453674:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+13:2396:x1868815120099584:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241623.453732:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+13:2396:x1868815120099584:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 58us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241623.453739:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 146 00000100:00080000:0.0:1782241623.453802:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241623.453807:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241623.453810:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241623.453813:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1782241623.754106:0:23364:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782241623.813251:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241623.813278:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140131840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241623.813367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241623.813457:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140131840 00000100:00100000:1.0:1782241623.813465:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140131840 00000100:00100000:1.0:1782241623.813527:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782241623.813537:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140131840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241623.813568:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1782241623.813619:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140131840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241623.813628:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782241623.813675:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140131840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782241623.813738:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782241623.815881:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782241623.823093:0:24940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7ba7844f-6088-459d-bcca-a5136f4f097b 00010000:00010000:0.0:1782241624.841826:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241625.867339:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241626.375671:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23eacdb9-0e56-4c3a-b421-5efac43515c0:3640:1868815140131968:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.375752:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241626.375823:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140132480:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.375854:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241626.375873:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140132992:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.375895:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241626.375911:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140133504:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.375929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241626.375952:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1782241626.375958:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140132352:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.375983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241626.375999:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140132864:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.376017:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241626.376034:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140133376:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.376054:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241626.376055:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140132352 00000100:00100000:2.0:1782241626.376063:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140132352 00000100:00100000:3.0:1782241626.376078:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140132096:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.376101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241626.376126:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140132864 00000100:00100000:3.0:1782241626.376129:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140132608:0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.376130:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140132864 00000100:00100000:3.0:1782241626.376150:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241626.376152:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241626.376161:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140132352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.376164:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140133120:0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.376219:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140132352:12345-0@lo:400:kworker.0 Request processed in 59us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241626.376227:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241626.376244:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241626.376261:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140132864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.376290:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140132864:12345-0@lo:400:kworker.0 Request processed in 30us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241626.376296:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1782241626.376312:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241626.376344:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140132352:0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.376354:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140132864:0@lo:400:kworker.0 00000100:00100000:1.0:1782241626.376693:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140131968 00000100:00100000:1.0:1782241626.376699:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140131968 00000100:00100000:1.0:1782241626.376737:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782241626.376745:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3640:x1868815140131968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241626.376808:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3640:x1868815140131968:12345-0@lo:400:kworker.0 Request processed in 64us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241626.376814:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782241626.377285:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140132480 00000100:00100000:0.0:1782241626.377292:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140132480 00000100:00100000:0.0:1782241626.377319:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140132992 00000100:00100000:0.0:1782241626.377322:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140132992 00000100:00100000:0.0:1782241626.377331:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140133504 00000100:00100000:0.0:1782241626.377334:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140133504 00000100:00100000:0.0:1782241626.377351:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140133376 00000100:00100000:0.0:1782241626.377354:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140133376 00000100:00100000:0.0:1782241626.377366:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782241626.377373:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140132480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241626.377548:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140132480:12345-0@lo:400:kworker.0 Request processed in 174us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.377555:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782241626.377570:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782241626.377576:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140132992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241626.377606:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140132992:12345-0@lo:400:kworker.0 Request processed in 30us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.377612:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782241626.377623:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782241626.377630:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140133504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241626.377657:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140133504:12345-0@lo:400:kworker.0 Request processed in 27us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.377663:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782241626.377686:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782241626.377693:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140133376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241626.377720:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140133376:12345-0@lo:400:kworker.0 Request processed in 28us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.377735:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782241626.377805:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140132096 00000100:00100000:0.0:1782241626.377809:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140132096 00000100:00100000:0.0:1782241626.377831:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140132608 00000100:00100000:0.0:1782241626.377834:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140132608 00000100:00100000:0.0:1782241626.377844:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782241626.377849:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140132096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241626.378069:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140132096:12345-0@lo:400:kworker.0 Request processed in 218us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.378075:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782241626.378088:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782241626.378095:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140132608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.378260:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140133376:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.378264:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241626.378275:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23eacdb9-0e56-4c3a-b421-5efac43515c0:3640:1868815140131968:0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.378286:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140132480:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.378302:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140132096:0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.378307:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140132992:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.378315:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00010000:00080000:2.0:1782241626.378320:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47b4dc00 x1868815140133504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241626.378330:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140132224:0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.378330:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140133504:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.378354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782241626.378354:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782241626.378359:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241626.378370:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140132736:0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.378371:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140132224 00000100:00100000:2.0:1782241626.378374:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140132224 00000100:00100000:3.0:1782241626.378412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241626.378412:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241626.378422:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140133248:0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.378428:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140132224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.378451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241626.378458:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140132224:12345-0@lo:400:kworker.0 Request processed in 41us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241626.378464:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241626.378467:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140132224:0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.378473:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140132736 00000100:00100000:2.0:1782241626.378476:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140132736 00000100:00100000:3.0:1782241626.378490:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140133120 00000100:00100000:3.0:1782241626.378493:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140133120 00000100:00100000:2.0:1782241626.378493:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782241626.378497:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e72eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140132736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.378509:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140133248 00000100:00100000:3.0:1782241626.378511:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140133248 00000100:00100000:3.0:1782241626.378525:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782241626.378528:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e72eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140132736:12345-0@lo:400:kworker.0 Request processed in 31us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241626.378531:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140133120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.378534:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782241626.378558:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140133120:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241626.378563:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782241626.378574:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782241626.378579:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140133248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.378598:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140133248:12345-0@lo:400:kworker.0 Request processed in 19us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241626.378603:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1782241626.378661:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241626.378664:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782241626.378666:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241626.378700:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140132736:0@lo:400:kworker.0 00010000:00080000:2.0:1782241626.378710:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c314a80 x1868815140133248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241626.378730:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140133248:0@lo:400:kworker.0 00000100:00100000:2.0:1782241626.378742:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140133120:0@lo:400:kworker.0 00000100:00100000:0.0:1782241626.379770:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140132608:12345-0@lo:400:kworker.0 Request processed in 1654us (3597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.379781:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782241626.379866:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140133632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241626.380586:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241626.380634:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140132608:0@lo:400:kworker.0 00000100:00100000:3.0:1782241626.382311:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140133760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241626.382373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241626.383322:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140133632 00000100:00100000:0.0:1782241626.383332:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140133632 00000100:00100000:0.0:1782241626.383373:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140133760 00000100:00100000:0.0:1782241626.383376:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140133760 00000100:00100000:0.0:1782241626.383461:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782241626.383474:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140133632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241626.383506:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782241626.383556:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140133632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (2971us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.383576:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782241626.383594:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782241626.383601:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140133760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241626.383613:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1782241626.383654:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140133760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.383661:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782241626.383717:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140133760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241626.383717:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140133632:0@lo:13:osp-pre-1-1.0 00000020:00000080:1.0:1782241626.429413:0:25644:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff52b3d7d0 20000000:00000080:1.0:1782241626.430255:0:25644:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890e7701ec00 uarg=0000000000000000 20000000:01000000:1.0:1782241626.430332:0:25644:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782241626.430340:0:25644:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782241626.430345:0:25644:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782241626.431401:0:25645:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1782241626.431699:0:25644:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1782241626.447586:0:25644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782241626.447838:0:25644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.447874:0:25644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1b325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b31e expref: 23 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.447882:0:25644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1b333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b32c expref: 23 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.447889:0:25644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4499a400/0xc9959f2fb1e1b372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b36b expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.447895:0:25644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1b4ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b4e5 expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.447905:0:25644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e7c311000/0xc9959f2fb1e1b658 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350570e expref: 12 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.447912:0:25644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e43fadc00/0xc9959f2fb1e1b697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350577e expref: 12 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.447920:0:25644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.447965:0:25644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e43fadc00/0xc9959f2fb1e1b697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350577e expref: 12 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.447982:0:25644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e43fadc00/0xc9959f2fb1e1b697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350577e expref: 12 pid: 22605 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241626.447998:0:25644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140133888:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241626.448705:0:25644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e7c311000/0xc9959f2fb1e1b658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350570e expref: 12 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.448728:0:25644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e7c311000/0xc9959f2fb1e1b658 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350570e expref: 12 pid: 22606 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241626.448740:0:25644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140134016:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241626.448829:0:25644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1b4ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b4e5 expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.448838:0:25644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1b4ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b4e5 expref: 23 pid: 22604 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241626.448849:0:25644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140134144:0@lo:104: 00000100:00100000:3.0:1782241626.448890:0:25644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241626.448933:0:25644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4499a400/0xc9959f2fb1e1b372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b36b expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.448942:0:25644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e4499a400/0xc9959f2fb1e1b372 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b36b expref: 23 pid: 22604 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241626.448950:0:25644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140134272:0@lo:104: 00000100:00100000:3.0:1782241626.448971:0:25644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241626.448996:0:25644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1b333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b32c expref: 23 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.449003:0:25644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1b333 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b32c expref: 23 pid: 22606 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241626.449011:0:25644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140134400:0@lo:104: 00000100:00100000:3.0:1782241626.449030:0:25644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241626.449057:0:25644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1b325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1b31e expref: 23 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.449064:0:25644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1b325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b31e expref: 23 pid: 22605 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241626.449071:0:25644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140134528:0@lo:104: 00000100:00100000:3.0:1782241626.449094:0:25644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241626.449103:0:25644:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc2180 going to sleep for 11 seconds 00000100:00100000:2.0:1782241626.449666:0:22595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140134144 00000100:00100000:2.0:1782241626.449676:0:22595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140134144 00000100:00100000:2.0:1782241626.449713:0:22595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140134272 00000100:00100000:2.0:1782241626.449716:0:22595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140134272 00000100:00100000:2.0:1782241626.449726:0:22595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140134400 00000100:00100000:2.0:1782241626.449728:0:22595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140134400 00000100:00100000:2.0:1782241626.449737:0:22595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140134528 00000100:00100000:2.0:1782241626.449739:0:22595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140134528 00000100:00100000:2.0:1782241626.449751:0:22595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782241626.449792:0:22595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+6:25644:x1868815140134144:12345-0@lo:104: 00010000:00010000:2.0:1782241626.449806:0:22595:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.452604:0:22595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782241626.452635:0:22595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+6:25644:x1868815140134144:12345-0@lo:104: Request processed in 2840us (3740us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241626.452650:0:22595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782241626.452689:0:22595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782241626.452700:0:22595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+5:25644:x1868815140134272:12345-0@lo:104: 00010000:00010000:2.0:1782241626.452716:0:22595:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.452808:0:22595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782241626.452826:0:22595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+5:25644:x1868815140134272:12345-0@lo:104: Request processed in 130us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241626.452833:0:22595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782241626.452847:0:22595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782241626.452853:0:22595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+4:25644:x1868815140134400:12345-0@lo:104: 00010000:00010000:2.0:1782241626.452861:0:22595:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.452898:0:22595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782241626.452903:0:22595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+4:25644:x1868815140134400:12345-0@lo:104: Request processed in 51us (3872us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241626.452910:0:22595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782241626.452924:0:22595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782241626.452930:0:22595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:25644:x1868815140134528:12345-0@lo:104: 00010000:00010000:2.0:1782241626.452937:0:22595:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.452964:0:22595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1782241626.452970:0:22595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+3:25644:x1868815140134528:12345-0@lo:104: Request processed in 41us (3876us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241626.452975:0:22595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1782241626.453000:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782241626.453006:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453015:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241626.453019:0:23368:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453038:0:23368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241626.453045:0:23368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241626.453050:0:23368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782241626.453085:0:23368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453092:0:23368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241626.453122:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453130:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e779ea000/0xc9959f2fb1e1b4e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b4ec expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453143:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782241626.453146:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453152:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241626.453155:0:23368:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453161:0:23368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241626.453779:0:23368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241626.453794:0:23368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782241626.453814:0:23368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453820:0:23368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241626.453828:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453835:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1b36b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b372 expref: -99 pid: 24117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453845:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782241626.453848:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453853:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310800 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241626.453856:0:23368:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453863:0:23368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241626.453868:0:23368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241626.453873:0:23368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782241626.453884:0:23368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453889:0:23368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241626.453916:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453923:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e7c310800/0xc9959f2fb1e1b32c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b333 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453932:0:23368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241626.453935:0:23368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453941:0:23368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fada00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241626.453944:0:23368:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453950:0:23368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241626.453956:0:23368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241626.453961:0:23368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782241626.453972:0:23368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453978:0:23368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241626.453983:0:23368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.453989:0:23368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e43fada00/0xc9959f2fb1e1b31e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1b325 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241626.454014:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241626.454015:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241626.454017:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241626.454027:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241626.454045:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140134656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241626.454092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241626.455275:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241626.455320:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140134912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241626.458970:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241626.459057:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241626.459072:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140135040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241626.459118:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241626.459153:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140134656 00000100:00100000:0.0:1782241626.459161:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140134912 00000100:00100000:1.0:1782241626.459163:0:22597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140134656 00000100:00100000:0.0:1782241626.459168:0:22599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140134912 00010000:00010000:0.0:1782241626.459206:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1b333 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b32c expref: 25 pid: 22606 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241626.459207:0:22597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1b4ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b4e5 expref: 25 pid: 22604 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241626.459264:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140135040 00000100:00100000:1.0:1782241626.459268:0:22597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140135040 00000100:00100000:0.0:1782241626.459270:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241626.459281:0:22599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23eacdb9-0e56-4c3a-b421-5efac43515c0+26:3639:x1868815140134656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241626.459284:0:22597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1b325 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b31e expref: 26 pid: 22605 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241626.459302:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241626.459308:0:22597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+26:3637:x1868815140134912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241626.459321:0:22597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241626.459326:0:22597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1b333 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b32c expref: 26 pid: 22606 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241626.459336:0:22597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1b333 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b32c expref: 26 pid: 22606 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241626.459356:0:22597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241626.459413:0:22597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+26:3637:x1868815140134912:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241626.459420:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241626.459441:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241626.459447:0:22597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+25:3637:x1868815140135040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241626.459470:0:22597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241626.459475:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241626.459476:0:22597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1b325 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b31e expref: 25 pid: 22605 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241626.459485:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1b4ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b4e5 expref: 25 pid: 22604 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241626.459490:0:22597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1b325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b31e expref: 25 pid: 22605 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241626.460000:0:25644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140134144:0@lo:104: 00000100:00100000:3.0:1782241626.460012:0:25644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140134272:0@lo:104: 00010000:00010000:3.0:1782241626.460020:0:25644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1b333 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b32c expref: 25 pid: 22606 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241626.460035:0:25644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140134400:0@lo:104: 00000100:00100000:3.0:1782241626.460044:0:25644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140134528:0@lo:104: 00000100:00100000:2.0:1782241626.460695:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241626.460711:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140134784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241626.460784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241626.460830:0:23768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1782241626.460839:0:23768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1782241626.461984:0:23768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140134784 00000100:00100000:3.0:1782241626.461995:0:23768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140134784 00010000:00010000:3.0:1782241626.462027:0:23768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4499a400/0xc9959f2fb1e1b372 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b36b expref: 25 pid: 22604 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241626.462059:0:23768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1782241626.462070:0:23768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782241626.462079:0:23768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23eacdb9-0e56-4c3a-b421-5efac43515c0+25:3639:x1868815140134784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241626.462092:0:23768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241626.462097:0:23768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4499a400/0xc9959f2fb1e1b372 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b36b expref: 25 pid: 22604 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241626.467905:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1b4ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b4e5 expref: 25 pid: 22604 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241626.467954:0:22599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1b4ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b4e5 expref: 25 pid: 22604 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241626.467971:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241626.468066:0:22599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3639:x1868815140134656:12345-0@lo:103:ldlm_bl.0 Request processed in 8785us (13971us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.468076:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241626.468157:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140134912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241626.468271:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241626.468297:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241626.468316:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120100736 00000100:00100000:0.0:1782241626.468322:0:22599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120100736 00010000:00010000:0.0:1782241626.468349:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e43fadc00/0xc9959f2fb1e1b697 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350577e expref: 13 pid: 22605 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241626.468369:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120100864 00000100:00100000:0.0:1782241626.468371:0:22599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120100864 00010000:00010000:0.0:1782241626.468383:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e7c311000/0xc9959f2fb1e1b658 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350570e expref: 14 pid: 22606 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241626.468397:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:0.0:1782241626.468405:0:22599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e50599c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596d410-35c6-4d46-bbb3-954c5be7798e+14:2398:x1868815120100736:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241626.468420:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241626.468425:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e43fadc00/0xc9959f2fb1e1b697 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350577e expref: 14 pid: 22605 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241626.468436:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e43fadc00/0xc9959f2fb1e1b697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350577e expref: 14 pid: 22605 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241626.468456:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241626.468496:0:22599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e50599c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596d410-35c6-4d46-bbb3-954c5be7798e+14:2398:x1868815120100736:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 92us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.468503:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:0.0:1782241626.468517:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:0.0:1782241626.468523:0:22599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596d410-35c6-4d46-bbb3-954c5be7798e+13:2398:x1868815120100864:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241626.468529:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241626.468533:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e7c311000/0xc9959f2fb1e1b658 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350570e expref: 13 pid: 22606 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241626.468542:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e7c311000/0xc9959f2fb1e1b658 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350570e expref: 13 pid: 22606 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241626.468551:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241626.468566:0:22599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596d410-35c6-4d46-bbb3-954c5be7798e+13:2398:x1868815120100864:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 43us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.468573:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:2.0:1782241626.470777:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140134656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241626.471056:0:22597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1b325 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b31e expref: 23 pid: 22605 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241626.471080:0:22597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241626.472916:0:23768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4499a400/0xc9959f2fb1e1b372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1b36b expref: 22 pid: 22604 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.472965:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4499a400/0xc9959f2fb1e1b372 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1b36b expref: 22 pid: 22604 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.472982:0:23768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.472993:0:23768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.473016:0:23768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.473023:0:23768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.473030:0:23768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241626.473040:0:22597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:3637:x1868815140135040:12345-0@lo:103:ldlm_bl.0 Request processed in 13587us (13916us total) trans 0 rc 0/0 00010000:00010000:3.0:1782241626.473041:0:23768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.473056:0:23768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241626.473061:0:23768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241626.473061:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1782241626.473074:0:23768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.473085:0:23768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.473119:0:23768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241626.473181:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23eacdb9-0e56-4c3a-b421-5efac43515c0:3637:1868815140135040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241626.473410:0:23768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:3639:x1868815140134784:12345-0@lo:103:ldlm_bl.0 Request processed in 11331us (12624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241626.473418:0:23768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1782241626.473494:0:25644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e43fadc00/0xc9959f2fb1e1b697 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350577e expref: 12 pid: 22605 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241626.473505:0:25644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140133888:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241626.473517:0:25644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e7c311000/0xc9959f2fb1e1b658 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350570e expref: 11 pid: 22606 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241626.473525:0:25644:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25644:1868815140134016:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241626.473548:0:25644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.473558:0:25644:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.473564:0:25644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241626.473569:0:25644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6c8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241626.481034:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23eacdb9-0e56-4c3a-b421-5efac43515c0:3639:1868815140134784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241626.885220:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241626.891137:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241626.891180:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140135168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241626.891280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241626.891718:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140135168 00000100:00100000:0.0:1782241626.891729:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140135168 00000100:00100000:0.0:1782241626.891818:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782241626.891829:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140135168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241626.891881:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1782241626.891949:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140135168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241626.891964:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782241626.892142:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140135168:0@lo:13:osp-pre-0-1.0 10000000:01000000:2.0:1782241627.653054:0:22609:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782241627.653065:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e735c9000 from 13 10000000:01000000:2.0:1782241627.653070:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782241627.653138:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fade00/0xc9959f2fb1e1b6cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241627.653151:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e43fade00/0xc9959f2fb1e1b6cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241627.653162:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e43fade00/0xc9959f2fb1e1b6cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241627.653191:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241627.653316:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241627.653369:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241627.653420:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140135296 00000100:00100000:3.0:1782241627.653430:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140135296 00000100:00100000:3.0:1782241627.653494:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782241627.653504:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+20:22609:x1868815140135296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241627.653519:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241627.653536:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b6cf expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241627.653562:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b6cf expref: 21 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241627.653573:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1b6d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b6cf expref: 21 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241627.653583:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb000, rc 0) 00000100:00100000:3.0:1782241627.653638:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:22609:x1868815140135296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241627.653645:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782241627.653667:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241627.653683:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e43fade00/0xc9959f2fb1e1b6cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b6d6 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241627.653693:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e43fade00/0xc9959f2fb1e1b6cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b6d6 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241627.653815:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241627.653854:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241627.653878:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241627.655353:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140135424 00000100:00100000:0.0:1782241627.655365:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140135424 00000100:00100000:0.0:1782241627.655443:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782241627.655453:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:22609:x1868815140135424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241627.655621:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d761c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:22609:x1868815140135424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241627.655629:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782241627.655915:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241627.655965:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241627.656017:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241627.656054:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241627.656103:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140135552 00000100:00100000:1.0:1782241627.656108:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140135552 00000100:00100000:1.0:1782241627.656150:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782241627.656157:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:22609:x1868815140135552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241627.656525:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:22609:x1868815140135552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 368us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241627.656533:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782241627.656626:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782241627.657837:0:25658:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1782241627.658144:0:22609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1782241627.658172:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241627.658183:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fade00/0xc9959f2fb1e1b6cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b6d6 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241627.658195:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e43fade00/0xc9959f2fb1e1b6cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b6d6 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241627.658207:0:22609:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782241627.658383:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e4813b000 from 13 10000000:01000000:2.0:1782241627.658387:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782241627.658422:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1b6dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241627.658430:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1b6dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241627.658441:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1b6dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241627.658462:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241627.658516:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241627.658557:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241627.658629:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140135680 00000100:00100000:0.0:1782241627.658636:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140135680 00000100:00100000:0.0:1782241627.658685:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782241627.658693:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+21:22609:x1868815140135680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241627.658705:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241627.658718:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e1b6e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b6dd expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241627.658949:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e1b6e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b6dd expref: 22 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241627.658960:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e1b6e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b6dd expref: 22 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241627.658969:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860400, rc 0) 00000100:00100000:0.0:1782241627.659109:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:22609:x1868815140135680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 415us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241627.659116:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782241627.660121:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241627.660139:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1b6dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b6e4 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241627.660150:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1b6dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b6e4 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241627.660464:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241627.660513:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241627.660596:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241627.660644:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140135808 00000100:00100000:1.0:1782241627.660650:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140135808 00000100:00100000:1.0:1782241627.660745:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782241627.660773:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:22609:x1868815140135808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241627.664932:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d760850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:22609:x1868815140135808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4164us (4405us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241627.664950:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782241627.668237:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47832a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241627.668340:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241627.668415:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241627.674483:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e778fc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241627.678030:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140135936 00000100:00100000:3.0:1782241627.678046:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140135936 00000100:00100000:3.0:1782241627.678108:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782241627.678117:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:22609:x1868815140135936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241627.678314:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:22609:x1868815140135936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (9898us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241627.678322:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782241627.678460:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140135936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782241627.684038:0:25659:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782241627.689009:0:22609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782241627.689063:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782241627.689092:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1b6dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b6e4 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241627.689104:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1b6dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b6e4 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241627.689118:0:22609:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782241627.689121:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d46921800 from 13 10000000:01000000:3.0:1782241627.689124:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241627.689173:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ebc00/0xc9959f2fb1e1b6eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241627.689183:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779ebc00/0xc9959f2fb1e1b6eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241627.689198:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779ebc00/0xc9959f2fb1e1b6eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241627.689473:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241627.689551:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241627.689659:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241627.691650:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140136064 00000100:00100000:0.0:1782241627.691667:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140136064 00000100:00100000:0.0:1782241627.691989:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782241627.692001:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+22:22609:x1868815140136064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241627.692023:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241627.692045:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e1b6f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b6eb expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241627.692075:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e1b6f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b6eb expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241627.692088:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e1b6f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b6eb expref: 23 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241627.692100:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861000, rc 0) 00000100:00100000:0.0:1782241627.692313:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d760450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:22609:x1868815140136064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 313us (2761us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241627.692321:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782241627.698141:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241627.698181:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779ebc00/0xc9959f2fb1e1b6eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b6f2 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241627.698196:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779ebc00/0xc9959f2fb1e1b6eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b6f2 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241627.703567:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241627.703660:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241627.703725:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46780 going to sleep for 11 seconds 00000100:00100000:0.0:1782241627.703952:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140136192 00000100:00100000:0.0:1782241627.703961:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140136192 00000100:00100000:0.0:1782241627.704014:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782241627.704024:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:22609:x1868815140136192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241627.704153:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d761850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:22609:x1868815140136192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241627.704171:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782241627.704455:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241627.704493:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241627.704537:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241627.704569:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46780 going to sleep for 11 seconds 00000100:00100000:0.0:1782241627.704652:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140136320 00000100:00100000:0.0:1782241627.704657:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140136320 00000100:00100000:0.0:1782241627.704691:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782241627.704697:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:22609:x1868815140136320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241627.704815:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d763050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:22609:x1868815140136320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241627.704822:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782241627.705034:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782241627.706431:0:25660:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782241627.711490:0:22609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782241627.711541:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782241627.711554:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ebc00/0xc9959f2fb1e1b6eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b6f2 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241627.711568:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779ebc00/0xc9959f2fb1e1b6eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b6f2 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241627.711581:0:22609:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782241627.711584:0:22609:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d46713800 from 13 10000000:01000000:3.0:1782241627.711587:0:22609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241627.711633:0:22609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1b6f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241627.711642:0:22609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1b6f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241627.711653:0:22609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1b6f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241627.711680:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241627.712971:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241627.713076:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241627.717797:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140136448 00000100:00100000:1.0:1782241627.717813:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140136448 00000100:00100000:1.0:1782241627.717876:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782241627.717886:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+23:22609:x1868815140136448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241627.717903:0:22605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241627.717923:0:22605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e7c310400/0xc9959f2fb1e1b700 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1b6f9 expref: -99 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241627.717956:0:22605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e7c310400/0xc9959f2fb1e1b700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b6f9 expref: 24 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241627.717969:0:22605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e7c310400/0xc9959f2fb1e1b700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1b6f9 expref: 24 pid: 22605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241627.717979:0:22605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c310400, rc 0) 00000100:00100000:1.0:1782241627.718055:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d763850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:22609:x1868815140136448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (5090us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241627.718062:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782241627.723566:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241627.723599:0:22609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1b6f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b700 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241627.723615:0:22609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1b6f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1b700 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241627.723792:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241627.723861:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241627.723918:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241627.724148:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140136576 00000100:00100000:2.0:1782241627.724156:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140136576 00000100:00100000:2.0:1782241627.724217:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782241627.724237:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:22609:x1868815140136576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241627.724410:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:22609:x1868815140136576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241627.724420:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782241627.724503:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241627.724545:0:22609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48099500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241627.724600:0:22609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241627.724635:0:22609:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e778fc300 going to sleep for 11 seconds 00000100:00100000:2.0:1782241627.724731:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140136704 00000100:00100000:2.0:1782241627.724736:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140136704 00000100:00100000:2.0:1782241627.724801:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782241627.724808:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:22609:x1868815140136704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241627.724898:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:22609:x1868815140136704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241627.724904:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782241627.724983:0:22609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48099500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23eacdb9-0e56-4c3a-b421-5efac43515c0:22609:1868815140136704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782241627.726007:0:25661:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1782241627.726175:0:22609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1782241627.726202:0:22609:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782241627.726214:0:22609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1b6f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b700 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241627.726236:0:22609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1b6f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1b700 expref: -99 pid: 22609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241627.909110:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241627.909133:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140136960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241627.909202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241627.909274:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140136960 00000100:00100000:0.0:1782241627.909283:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140136960 00000100:00100000:0.0:1782241627.909335:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782241627.909344:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140136960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241627.909388:0:22617:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782241627.909439:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140136960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241627.909448:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782241627.909512:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140136960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241627.909784:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241627.909797:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140136832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241627.909838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241627.910121:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241627.910339:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140136832 00000100:00100000:0.0:1782241627.910346:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140136832 00000100:00100000:0.0:1782241627.910386:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782241627.910395:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140136832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241627.910422:0:23684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1782241627.910477:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140136832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241627.910484:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782241627.910561:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140136832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241628.061397:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241628.063051:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120100992 00000100:00100000:2.0:1782241628.063069:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120100992 00000100:00100000:2.0:1782241628.063205:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 160 00000100:00100000:2.0:1782241628.063228:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+11:18125:x1868815120100992:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241628.063247:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241628.063268:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1b707 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057b6 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241628.063326:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1b707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057b6 expref: 12 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241628.063337:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1b707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057b6 expref: 12 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241628.063347:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad800, rc 0) 00000100:00100000:2.0:1782241628.063540:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+12:18125:x1868815120100992:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 Request processed in 324us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241628.063548:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 160 00000100:00100000:0.0:1782241628.069496:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.069592:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120101120 00000100:00100000:3.0:1782241628.069604:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120101120 00000100:00100000:3.0:1782241628.069669:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 161 00000100:00100000:3.0:1782241628.069680:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+12:18125:x1868815120101120:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241628.069995:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+12:18125:x1868815120101120:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 Request processed in 315us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241628.070003:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 161 00000100:00100000:1.0:1782241628.075118:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.075253:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120101248 00000100:00100000:3.0:1782241628.075263:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120101248 00000100:00100000:3.0:1782241628.075414:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 162 00000100:00100000:3.0:1782241628.075426:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+12:18125:x1868815120101248:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241628.075585:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+12:18125:x1868815120101248:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 Request processed in 160us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241628.075594:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 162 00000100:00100000:1.0:1782241628.114618:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241628.115084:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120101376 00000100:00100000:2.0:1782241628.115094:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120101376 00000100:00100000:2.0:1782241628.115179:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 163 00000100:00100000:2.0:1782241628.115189:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+12:18125:x1868815120101376:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241628.115208:0:22604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241628.115239:0:22604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b70e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057bd expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241628.115270:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b70e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057bd expref: 13 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241628.115283:0:22604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e43face00/0xc9959f2fb1e1b70e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057bd expref: 13 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241628.115292:0:22604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43face00, rc 0) 00000100:00100000:2.0:1782241628.115359:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18125:x1868815120101376:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 Request processed in 171us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241628.115385:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 163 00000100:00100000:1.0:1782241628.118617:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.119416:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120101504 00000100:00100000:3.0:1782241628.119428:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120101504 00000100:00100000:3.0:1782241628.119545:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 164 00000100:00100000:3.0:1782241628.119556:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18125:x1868815120101504:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241628.119733:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18125:x1868815120101504:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 Request processed in 178us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241628.119778:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 164 00000100:00100000:3.0:1782241628.130555:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241628.133740:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120101632 00000100:00100000:1.0:1782241628.133777:0:22606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120101632 00000100:00100000:1.0:1782241628.133871:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 165 00000100:00100000:1.0:1782241628.133882:0:22606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18125:x1868815120101632:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241628.134386:0:22606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596d410-35c6-4d46-bbb3-954c5be7798e+13:18125:x1868815120101632:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 Request processed in 503us (3838us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241628.134404:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 165 00000100:00100000:1.0:1782241628.358005:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.358309:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120101760 00000100:00100000:3.0:1782241628.358321:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120101760 00000100:00100000:3.0:1782241628.358431:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:3.0:1782241628.358443:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:18749:x1868815120101760:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241628.358467:0:22612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241628.358496:0:22612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1b715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057c4 expref: -99 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358576:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b71c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358591:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b71c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358604:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b71c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358618:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b723 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358626:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358633:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358720:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1b72a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358745:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1b72a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358752:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1b72a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241628.358835:0:22612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782241628.358840:0:22612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241628.358877:0:22612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1b72a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358888:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b71c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358895:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b71c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358902:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b71c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358909:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241628.358914:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b71c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358922:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b71c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358935:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4781d000) 00010000:00010000:3.0:1782241628.358938:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241628.358942:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b71c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358958:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b71c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358972:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358978:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b723 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358984:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358989:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241628.358992:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.358997:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b723 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.359006:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff890d4195ee00) 00010000:00010000:3.0:1782241628.359008:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241628.359011:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b723 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.359017:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b723 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.359052:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1b715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057c4 expref: 8 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.359080:0:22612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1b72a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057c4 expref: 7 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.359099:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890d4195ec00) 00010000:00010000:3.0:1782241628.359102:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782241628.359104:0:22612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb400, rc 0) 00000100:00100000:3.0:1782241628.359165:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:18749:x1868815120101760:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 725us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241628.359172:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00080000:2.0:1782241628.359715:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241628.366438:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241628.366551:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120101888 00000100:00100000:2.0:1782241628.366562:0:22623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120101888 00000100:00100000:2.0:1782241628.366628:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:2.0:1782241628.366639:0:22623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:18749:x1868815120101888:12345-192.168.204.58@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1782241628.366732:0:22623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:18749:x1868815120101888:12345-192.168.204.58@tcp:900:lhsmtool_posix.0 Request processed in 94us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241628.366740:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:1.0:1782241628.376862:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.377003:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120102144 00000100:00100000:3.0:1782241628.377013:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120102144 00000100:00100000:3.0:1782241628.377071:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:3.0:1782241628.377081:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:18749:x1868815120102144:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241628.377105:0:22611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241628.377127:0:22611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1b731 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057cb expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377220:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b738 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377235:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b738 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377246:0:22611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b738 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377261:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b73f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377282:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b73f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377288:0:22611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b73f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377405:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e1b746 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377414:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e1b746 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377422:0:22611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e1b746 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241628.377433:0:22611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1782241628.377604:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b738 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377612:0:22611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b738 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377619:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b738 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377625:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241628.377629:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b738 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377637:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b738 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377660:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890d4195ec00) 00010000:00010000:3.0:1782241628.377664:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241628.377668:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b738 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377675:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b738 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377687:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b73f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377693:0:22611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b73f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377699:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b73f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377705:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241628.377708:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b73f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377715:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b73f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377722:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff890d4195ee00) 00010000:00010000:3.0:1782241628.377724:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241628.377726:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b73f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.377732:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b73f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.380732:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1b731 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057cb expref: 10 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.380903:0:22611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e1b746 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057cb expref: 9 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.380914:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890d4195eb00) 00010000:00010000:1.0:1782241628.380917:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241628.380920:0:22611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eba00, rc 0) 00000100:00100000:1.0:1782241628.381035:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+9:18749:x1868815120102144:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 3953us (4180us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1782241628.381057:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:1.0:1782241628.390355:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.391565:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120102272 00000100:00100000:3.0:1782241628.391578:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120102272 00000100:00100000:3.0:1782241628.391652:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:3.0:1782241628.391663:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+9:18749:x1868815120102272:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782241628.391811:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+9:18749:x1868815120102272:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 Request processed in 149us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241628.391820:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:0.0:1782241628.396463:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241628.396567:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120102400 00000100:00100000:2.0:1782241628.396577:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120102400 00000100:00100000:2.0:1782241628.396661:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:2.0:1782241628.396672:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:18749:x1868815120102400:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1782241628.396997:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1782241628.398911:0:22613:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2193us 00000100:00100000:2.0:1782241628.429773:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:18749:x1868815120102400:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 Request processed in 33073us (33287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241628.429789:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:0.0:1782241628.469943:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.470038:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120102528 00000100:00100000:3.0:1782241628.470048:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120102528 00000100:00100000:3.0:1782241628.470110:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:3.0:1782241628.470120:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+9:18755:x1868815120102528:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241628.470141:0:24571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241628.470161:0:24571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b754 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057d2 expref: -99 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470240:0:24571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b75b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470256:0:24571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b75b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470268:0:24571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b75b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470334:0:24571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b762 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470342:0:24571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470363:0:24571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470407:0:24571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b75b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470415:0:24571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b75b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470421:0:24571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b75b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470427:0:24571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241628.470431:0:24571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b75b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470438:0:24571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b75b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470450:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4781d000) 00010000:00010000:3.0:1782241628.470453:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241628.470457:0:24571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b75b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470463:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b75b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470477:0:24571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470482:0:24571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b762 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470494:0:24571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b762 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470500:0:24571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241628.470503:0:24571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b762 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470510:0:24571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b762 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470518:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff890d4195ee00) 00010000:00010000:3.0:1782241628.470520:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241628.470523:0:24571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b762 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470528:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b762 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470560:0:24571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b754 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057d2 expref: 10 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470569:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4781d000) 00010000:00010000:3.0:1782241628.470571:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241628.470575:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057d2 expref: 10 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.470584:0:24571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea000, rc 0) 00000100:00100000:3.0:1782241628.470651:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+9:18755:x1868815120102528:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 532us (717us total) trans 0 rc 301/301 00000100:00100000:3.0:1782241628.470667:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:0.0:1782241628.488829:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.488984:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120102656 00000100:00100000:3.0:1782241628.488996:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120102656 00000100:00100000:3.0:1782241628.489056:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:3.0:1782241628.489066:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+9:18755:x1868815120102656:12345-192.168.204.58@tcp:700:lfs.0 00000100:00100000:3.0:1782241628.489159:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+9:18755:x1868815120102656:12345-192.168.204.58@tcp:700:lfs.0 Request processed in 93us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241628.489167:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:1.0:1782241628.492376:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.492470:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120102912 00000100:00100000:3.0:1782241628.492481:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120102912 00000100:00100000:3.0:1782241628.492550:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:3.0:1782241628.492562:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+9:18755:x1868815120102912:12345-192.168.204.58@tcp:36:lfs.0 00010000:00010000:3.0:1782241628.492628:0:22611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241628.492653:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b682 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350573f expref: 9 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.492673:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4781d000) 00010000:00010000:3.0:1782241628.492678:0:22611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241628.492734:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.492747:0:22611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057af expref: 5 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.492807:0:22611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.492856:0:22611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057af expref: 5 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.492870:0:22611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057af expref: 5 pid: 24571 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241628.492885:0:22611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22611:1868815140137088:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241628.492957:0:22611:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241628.496953:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241628.497054:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120103040 00000100:00100000:0.0:1782241628.497064:0:22599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120103040 00010000:00010000:0.0:1782241628.497126:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057af expref: 6 pid: 24571 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241628.497167:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:0.0:1782241628.497177:0:22599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2398:x1868815120103040:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241628.497192:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241628.497198:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057af expref: 6 pid: 24571 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.497240:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057af expref: 6 pid: 24571 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.497271:0:22599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4781d000) 00010000:00010000:0.0:1782241628.497276:0:22599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.497286:0:22599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.497294:0:22599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.497311:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241628.497367:0:22599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2398:x1868815120103040:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 191us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241628.497376:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00080000:2.0:1782241628.497446:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782241628.497499:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b6c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057af expref: 5 pid: 24571 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241628.497522:0:22611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22611:1868815140137088:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241628.497544:0:22611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.497554:0:22611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.497560:0:22611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.497582:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.497596:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.497607:0:22611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501724:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501753:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501811:0:22611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782241628.501830:0:22611:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068a9db3c reply state 000000007d88c3e1 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501856:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501865:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:3.0:1782241628.501868:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782241628.501872:0:22611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782241628.501879:0:22611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782241628.501886:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501893:0:22611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501900:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501906:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241628.501910:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501930:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501942:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4781d000) 00010000:00010000:3.0:1782241628.501945:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241628.501949:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501956:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b769 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782241628.501975:0:22611:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068a9db3c reply state 000000007d88c3e1 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501984:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.501990:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff890d4195ee00) 00010000:00010000:3.0:1782241628.501992:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782241628.501994:0:22611:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1782241628.503100:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+10:18755:x1868815120102912:12345-192.168.204.58@tcp:36:lfs.0 Request processed in 10524us (10717us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1782241628.503114:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:2.0:1782241628.570652:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241628.570689:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241628.570716:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241628.570742:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241628.570833:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241628.570860:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120103168 00000100:00100000:2.0:1782241628.570869:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120103168 00000100:00100000:2.0:1782241628.570919:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120103680 00000100:00100000:2.0:1782241628.570922:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120103680 00000100:00100000:2.0:1782241628.570953:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120103296 00000100:00100000:2.0:1782241628.570956:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120103296 00000100:00100000:2.0:1782241628.570970:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120103552 00000100:00100000:2.0:1782241628.570972:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120103552 00000100:00100000:2.0:1782241628.570988:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:1.0:1782241628.570994:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:2.0:1782241628.570996:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2397:x1868815120103168:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241628.571002:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120103680:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241628.571093:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120103424 00000100:00100000:0.0:1782241628.571098:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120103424 00000100:00100000:0.0:1782241628.571134:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:0.0:1782241628.571142:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120103424:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241628.571214:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2397:x1868815120103168:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 208us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241628.571216:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120103680:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 216us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241628.571222:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:1.0:1782241628.571303:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:1.0:1782241628.571318:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:1.0:1782241628.571324:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2397:x1868815120103296:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241628.571351:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2397:x1868815120103296:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 28us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241628.571357:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:1.0:1782241628.571370:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:1.0:1782241628.571376:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120103552:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241628.571397:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120103552:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 22us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241628.571404:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00080000:1.0:1782241628.571881:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241628.571887:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241628.571889:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241628.571895:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120103424:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 752us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241628.571903:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:2.0:1782241628.651265:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241628.651376:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120103808 00000100:00100000:0.0:1782241628.651395:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120103808 00000100:00100000:0.0:1782241628.651456:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:0.0:1782241628.651480:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+10:18763:x1868815120103808:12345-192.168.204.58@tcp:101:lctl.0 00010000:00010000:0.0:1782241628.651506:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241628.651531:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861600/0xc9959f2fb1e1b77e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057d9 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.651606:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860200/0xc9959f2fb1e1b785 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.651620:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860200/0xc9959f2fb1e1b785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.651631:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860200/0xc9959f2fb1e1b785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241628.651679:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782241628.651683:0:22613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241628.651715:0:22613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860200/0xc9959f2fb1e1b785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.651953:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861600/0xc9959f2fb1e1b77e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057d9 expref: 12 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.651972:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860200/0xc9959f2fb1e1b785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057d9 expref: 11 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.651980:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195d300) 00010000:00010000:0.0:1782241628.651983:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241628.651987:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860200, rc 0) 00000100:00100000:0.0:1782241628.652052:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+11:18763:x1868815120103808:12345-192.168.204.58@tcp:101:lctl.0 Request processed in 573us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241628.652069:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:1.0:1782241628.701064:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241628.707320:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120103936 00000100:00100000:0.0:1782241628.707335:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120103936 00000100:00100000:0.0:1782241628.707417:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:0.0:1782241628.707427:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+5:18764:x1868815120103936:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241628.707447:0:22612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241628.707468:0:22612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861600/0xc9959f2fb1e1b78c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057e0 expref: -99 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.707535:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e1b793 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.707550:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e1b793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.707561:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e1b793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241628.707606:0:22612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782241628.707610:0:22612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241628.707632:0:22612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e1b793 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.707657:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861600/0xc9959f2fb1e1b78c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057e0 expref: 7 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.707675:0:22612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e1b793 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057e0 expref: 6 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.707703:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195d300) 00010000:00010000:0.0:1782241628.707707:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241628.707710:0:22612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861a00, rc 0) 00000100:00100000:0.0:1782241628.711715:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+6:18764:x1868815120103936:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 4273us (10654us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241628.711730:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:1.0:1782241628.723819:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241628.723896:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120104064 00000100:00100000:0.0:1782241628.723905:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120104064 00000100:00100000:0.0:1782241628.723964:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:0.0:1782241628.723973:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+6:18764:x1868815120104064:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241628.723994:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241628.724015:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b79a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057e7 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724091:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860e00/0xc9959f2fb1e1b7a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724106:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860e00/0xc9959f2fb1e1b7a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724117:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860e00/0xc9959f2fb1e1b7a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724128:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860a00/0xc9959f2fb1e1b7a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724136:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860a00/0xc9959f2fb1e1b7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724160:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860a00/0xc9959f2fb1e1b7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724255:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1b7af lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724265:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1b7af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724273:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1b7af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241628.724313:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782241628.724316:0:22613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241628.724335:0:22613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1b7af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724349:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860e00/0xc9959f2fb1e1b7a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724356:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860e00/0xc9959f2fb1e1b7a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724363:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860e00/0xc9959f2fb1e1b7a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724369:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860e00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241628.724375:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860e00/0xc9959f2fb1e1b7a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724383:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860e00/0xc9959f2fb1e1b7a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724401:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195d300) 00010000:00010000:0.0:1782241628.724404:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241628.724409:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860e00/0xc9959f2fb1e1b7a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724415:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860e00/0xc9959f2fb1e1b7a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724428:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860a00/0xc9959f2fb1e1b7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724435:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860a00/0xc9959f2fb1e1b7a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724440:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860a00/0xc9959f2fb1e1b7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724445:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241628.724448:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860a00/0xc9959f2fb1e1b7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724454:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860a00/0xc9959f2fb1e1b7a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724460:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff890d4195ee00) 00010000:00010000:0.0:1782241628.724463:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241628.724466:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860a00/0xc9959f2fb1e1b7a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724471:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860a00/0xc9959f2fb1e1b7a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724504:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b79a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057e7 expref: 8 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724517:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1b7af lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057e7 expref: 7 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.724526:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:0.0:1782241628.724528:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241628.724531:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861e00, rc 0) 00000100:00100000:0.0:1782241628.724589:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+7:18764:x1868815120104064:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 617us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241628.724597:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:2.0:1782241628.734416:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241628.734501:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120104192 00000100:00100000:0.0:1782241628.734512:0:22623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120104192 00000100:00100000:0.0:1782241628.734578:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:0.0:1782241628.734589:0:22623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7ba7844f-6088-459d-bcca-a5136f4f097b+5:18764:x1868815120104192:12345-192.168.204.58@tcp:900:lfs.0 00000100:00100000:0.0:1782241628.734680:0:22623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7ba7844f-6088-459d-bcca-a5136f4f097b+5:18764:x1868815120104192:12345-192.168.204.58@tcp:900:lfs.0 Request processed in 92us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241628.734688:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:1.0:1782241628.743726:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.743858:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120104448 00000100:00100000:3.0:1782241628.743869:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120104448 00000100:00100000:3.0:1782241628.743934:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:3.0:1782241628.743943:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+7:18764:x1868815120104448:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241628.743965:0:24571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241628.743984:0:24571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b7b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057ee expref: -99 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241628.744092:0:24571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782241628.744193:0:24571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b7b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057ee expref: 9 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.744222:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195d300) 00010000:00010000:3.0:1782241628.744225:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782241628.744230:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b7b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057ee expref: 9 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.744243:0:24571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea000, rc 0) 00000100:00100000:3.0:1782241628.744303:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+8:18764:x1868815120104448:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 362us (586us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1782241628.744310:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:1.0:1782241628.753811:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241628.753900:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120104704 00000100:00100000:0.0:1782241628.753911:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120104704 00000100:00100000:0.0:1782241628.753984:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 33 00000100:00100000:0.0:1782241628.753995:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+8:18764:x1868815120104704:12345-192.168.204.58@tcp:36:lfs.0 00010000:00010000:0.0:1782241628.754063:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241628.754095:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1b7af lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057e7 expref: 8 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.754130:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:0.0:1782241628.754135:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782241628.754162:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.754174:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.754183:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782241628.754421:0:22613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003919785c reply state 000000000548fac9 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.754433:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.754439:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:0.0:1782241628.754441:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1782241628.754444:0:22613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782241628.754453:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782241628.754540:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+9:18764:x1868815120104704:12345-192.168.204.58@tcp:36:lfs.0 Request processed in 546us (739us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1782241628.754547:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 33 00000100:00100000:2.0:1782241628.757403:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.757496:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120104960 00000100:00100000:3.0:1782241628.757507:0:22615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120104960 00000100:00100000:3.0:1782241628.757566:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:3.0:1782241628.757577:0:22615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+9:18764:x1868815120104960:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:3.0:1782241628.757851:0:22615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+10:18764:x1868815120104960:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 275us (454us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1782241628.757859:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:1.0:1782241628.760397:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.760527:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120105216 00000100:00100000:3.0:1782241628.760538:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120105216 00000100:00100000:3.0:1782241628.760602:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00100000:3.0:1782241628.760613:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+10:18764:x1868815120105216:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241628.760634:0:24571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241628.760655:0:24571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b7cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057f5 expref: -99 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.760750:0:24571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b7d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.760801:0:24571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.760812:0:24571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.760823:0:24571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b7d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.760831:0:24571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.760838:0:24571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241628.761107:0:24571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782241628.761193:0:24571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761213:0:24571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b7d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761220:0:24571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b7d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761226:0:24571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241628.761231:0:24571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b7d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761249:0:24571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b7d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761263:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195d300) 00010000:00010000:3.0:1782241628.761266:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241628.761271:0:24571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b7d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761278:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b7d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761290:0:24571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761297:0:24571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b7d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761303:0:24571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761308:0:24571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241628.761311:0:24571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761317:0:24571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b7d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761323:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff890d4195ee00) 00010000:00010000:3.0:1782241628.761326:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241628.761329:0:24571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b7d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761344:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b7d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761530:0:24571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b7cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057f5 expref: 12 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761542:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195d300) 00010000:00010000:3.0:1782241628.761544:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782241628.761548:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b7cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057f5 expref: 12 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241628.761558:0:24571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea000, rc 0) 00000100:00100000:3.0:1782241628.761686:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ba7844f-6088-459d-bcca-a5136f4f097b+11:18764:x1868815120105216:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 1074us (1307us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1782241628.761695:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00100000:1.0:1782241628.774513:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241628.774705:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120105344 00000100:00100000:0.0:1782241628.774715:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120105344 00000100:00100000:1.0:1782241628.774996:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 35 00000100:00100000:1.0:1782241628.775007:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+11:18764:x1868815120105344:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241628.775031:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241628.775051:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b7e7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335057fc expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.775742:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.775779:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.775795:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241628.775831:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782241628.775836:0:22613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241628.775858:0:22613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.775889:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b7e7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057fc expref: 13 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.775908:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057fc expref: 12 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.775917:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:1.0:1782241628.775932:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241628.775936:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c310800, rc 0) 00000100:00100000:1.0:1782241628.776158:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ba7844f-6088-459d-bcca-a5136f4f097b+12:18764:x1868815120105344:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 1151us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241628.776167:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 35 00000100:00100000:2.0:1782241628.783239:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241628.783368:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120105472 00000100:00100000:3.0:1782241628.783395:0:22615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120105472 00000100:00100000:3.0:1782241628.783463:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:3.0:1782241628.783475:0:22615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+12:18764:x1868815120105472:12345-192.168.204.58@tcp:37:lfs.0 00000100:00100000:2.0:1782241628.800229:0:22615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+12:18764:x1868815120105472:12345-192.168.204.58@tcp:37:lfs.0 Request processed in 16742us (16986us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241628.800253:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:1.0:1782241628.810910:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241628.812370:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120105728 00000100:00100000:0.0:1782241628.812395:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120105728 00000100:00100000:0.0:1782241628.812461:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:0.0:1782241628.812472:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477e3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ba7844f-6088-459d-bcca-a5136f4f097b+12:18764:x1868815120105728:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:0.0:1782241628.812725:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477e3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ba7844f-6088-459d-bcca-a5136f4f097b+13:18764:x1868815120105728:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 254us (1826us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1782241628.812733:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 4 00000040:00080000:3.0:1782241628.871753:0:23364:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782241628.913604:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241628.919172:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120105856 00000100:00100000:1.0:1782241628.919190:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120105856 00000100:00100000:1.0:1782241628.919276:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 36 00000100:00100000:1.0:1782241628.919286:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+11:18770:x1868815120105856:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241628.919306:0:22612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241628.919328:0:22612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b7f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505803 expref: -99 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919410:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b7fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919426:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b7fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919440:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b7fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919451:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b803 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919458:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919465:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919575:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e1b80a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919585:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e1b80a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919593:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e1b80a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241628.919909:0:22612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782241628.919915:0:22612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241628.919951:0:22612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e1b80a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919964:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b7fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919971:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b7fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919978:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b7fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919984:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241628.919988:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b7fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.919995:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b7fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920007:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195d300) 00010000:00010000:1.0:1782241628.920017:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241628.920022:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b7fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920028:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b7fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920043:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920049:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b803 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920054:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b803 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920058:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241628.920061:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b803 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920067:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b803 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920074:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff890d4195ee00) 00010000:00010000:1.0:1782241628.920076:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241628.920079:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b803 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920084:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b803 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920113:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b7f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505803 expref: 13 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920138:0:22612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e1b80a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505803 expref: 12 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.920145:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:1.0:1782241628.920147:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782241628.920150:0:22612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164de00, rc 0) 00000100:00100000:1.0:1782241628.920315:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+12:18770:x1868815120105856:12345-192.168.204.58@tcp:101:bash.0 Request processed in 1029us (6720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241628.920325:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 36 00000100:00100000:1.0:1782241628.931790:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241628.931871:0:22623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120105984 00000100:00100000:0.0:1782241628.931880:0:22623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120105984 00000100:00100000:0.0:1782241628.931939:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:0.0:1782241628.931950:0:22623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:18770:x1868815120105984:12345-192.168.204.58@tcp:900:bash.0 00000100:00100000:0.0:1782241628.932040:0:22623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:18770:x1868815120105984:12345-192.168.204.58@tcp:900:bash.0 Request processed in 92us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241628.932049:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:3.0:1782241628.932934:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241628.932953:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140137216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241628.933006:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241628.933094:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140137216 00000100:00100000:1.0:1782241628.933100:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140137216 00000100:00100000:1.0:1782241628.933157:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782241628.933165:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140137216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241628.933190:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1782241628.933239:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140137216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241628.933246:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1782241628.933367:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782241628.933427:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241628.933498:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140137216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782241628.935264:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241628.935361:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120106240 00000100:00100000:1.0:1782241628.935371:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120106240 00000100:00100000:1.0:1782241628.935438:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 37 00000100:00100000:1.0:1782241628.935448:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+12:18770:x1868815120106240:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241628.935467:0:22611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241628.935486:0:22611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b811 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350580a expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.935618:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.935648:0:22611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057fc expref: 12 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.935658:0:22611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.935693:0:22611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057fc expref: 12 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.935707:0:22611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057fc expref: 12 pid: 22613 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241628.935721:0:22611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22611:1868815140137344:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241628.935830:0:22611:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e508a5300 going to sleep for 11 seconds 00000100:00100000:1.0:1782241628.940658:0:22611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22611:1868815140137344:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241628.940693:0:22611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241628.954475:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241628.955249:0:25646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120106368 00000100:00100000:0.0:1782241628.955260:0:25646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120106368 00010000:00010000:0.0:1782241628.955303:0:25646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057fc expref: 13 pid: 22613 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241628.955347:0:25646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:0.0:1782241628.955357:0:25646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ba7844f-6088-459d-bcca-a5136f4f097b+13:2399:x1868815120106368:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241628.955372:0:25646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241628.955389:0:25646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057fc expref: 13 pid: 22613 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.955403:0:25646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057fc expref: 13 pid: 22613 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.955424:0:25646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b7ee lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335057fc expref: 13 pid: 22613 timeout: 792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.955455:0:25646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:0.0:1782241628.955460:0:25646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.955469:0:25646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.955477:0:25646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241628.955513:0:25646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241628.955583:0:25646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ba7844f-6088-459d-bcca-a5136f4f097b+12:2399:x1868815120106368:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 226us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241628.955591:0:25646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 16 00010000:00010000:1.0:1782241628.956876:0:22611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.956896:0:22611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.956927:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.956953:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.956964:0:22611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.957986:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b826 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958002:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b826 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958010:0:22611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b826 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241628.958022:0:22611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782241628.958053:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958060:0:22611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958068:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958222:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241628.958228:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958238:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958264:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:1.0:1782241628.958266:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241628.958271:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958278:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b818 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782241628.958292:0:22611:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000310d295d reply state 00000000b79cfb5c transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958302:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958309:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff890e81fbc500) 00010000:00010000:1.0:1782241628.958311:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241628.958313:0:22611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782241628.958354:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b811 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350580a expref: 15 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958369:0:22611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b826 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350580a expref: 14 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.958825:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241628.958827:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1782241628.958830:0:22611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c600, rc 0) 00000100:00100000:1.0:1782241628.958953:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+15:18770:x1868815120106240:12345-192.168.204.58@tcp:101:bash.0 Request processed in 23504us (23695us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1782241628.958963:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 37 00000100:00100000:2.0:1782241628.982062:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241628.982165:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120106496 00000100:00100000:1.0:1782241628.982177:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120106496 00000100:00100000:1.0:1782241628.982254:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 38 00000100:00100000:1.0:1782241628.982264:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+15:18770:x1868815120106496:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241628.982288:0:22612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241628.982309:0:22612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b834 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505811 expref: -99 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.982390:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b83b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.982404:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b83b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.982416:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b83b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241628.982469:0:22612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782241628.982473:0:22612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241628.982492:0:22612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b83b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.982503:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b83b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.982527:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b834 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505811 expref: 17 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.982548:0:22612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b83b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505811 expref: 16 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241628.982574:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241628.982577:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241628.982580:0:22612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d000, rc 0) 00000100:00100000:1.0:1782241628.982650:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+16:18770:x1868815120106496:12345-192.168.204.58@tcp:101:bash.0 Request processed in 387us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241628.982658:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 38 00000100:00100000:2.0:1782241628.986692:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241628.986831:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120106752 00000100:00100000:0.0:1782241628.986841:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120106752 00000100:00100000:0.0:1782241628.986899:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:0.0:1782241628.986911:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+16:18770:x1868815120106752:12345-192.168.204.58@tcp:35:bash.0 00000100:00100000:0.0:1782241628.987225:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+17:18770:x1868815120106752:12345-192.168.204.58@tcp:35:bash.0 Request processed in 315us (540us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1782241628.987234:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:0.0:1782241629.160694:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241629.160805:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120107008 00000100:00100000:2.0:1782241629.160817:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120107008 00000100:00100000:2.0:1782241629.160882:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 39 00000100:00100000:2.0:1782241629.160908:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+17:18780:x1868815120107008:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241629.160936:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241629.160963:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1b842 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505818 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241629.161087:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782241629.161206:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1b842 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505818 expref: 19 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241629.161222:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195d300) 00010000:00010000:2.0:1782241629.161225:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241629.161230:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1b842 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505818 expref: 19 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241629.161246:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad600, rc 0) 00000100:00100000:2.0:1782241629.161321:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+18:18780:x1868815120107008:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 414us (637us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1782241629.161330:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 39 00000100:00100000:3.0:1782241629.165522:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241629.165634:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120107264 00000100:00100000:0.0:1782241629.165644:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120107264 00000100:00100000:0.0:1782241629.165705:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:0.0:1782241629.165715:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+18:18780:x1868815120107264:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:0.0:1782241629.166025:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+19:18780:x1868815120107264:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 311us (512us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1782241629.166033:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:0.0:1782241629.268870:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241629.269306:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120107520 00000100:00100000:1.0:1782241629.269320:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120107520 00000100:00100000:1.0:1782241629.269415:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 40 00000100:00100000:1.0:1782241629.269429:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+19:18783:x1868815120107520:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241629.269472:0:22612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241629.269513:0:22612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b850 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350581f expref: -99 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.269689:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b857 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.269709:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b857 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.269722:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b857 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241629.269738:0:22612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782241629.269945:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b850 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350581f expref: 22 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.269998:0:22612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b857 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350581f expref: 21 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.270009:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241629.270013:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241629.270017:0:22612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c800, rc 0) 00000100:00100000:1.0:1782241629.270330:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+21:18783:x1868815120107520:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 903us (1477us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1782241629.270984:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 40 00000100:00100000:3.0:1782241629.282684:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241629.282992:0:23768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120107648 00000100:00100000:2.0:1782241629.283006:0:23768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120107648 00000100:00100000:2.0:1782241629.283169:0:23768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:2.0:1782241629.283183:0:23768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+21:2397:x1868815120107648:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241629.283215:0:23768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241629.283251:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b857 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350581f expref: 21 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241629.283279:0:23768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241629.283293:0:23768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241629.283382:0:23768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+20:2397:x1868815120107648:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 201us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241629.283392:0:23768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:2.0:1782241629.291550:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241629.291745:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120107776 00000100:00100000:1.0:1782241629.291791:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120107776 00000100:00100000:1.0:1782241629.291877:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 41 00000100:00100000:1.0:1782241629.291890:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+20:18783:x1868815120107776:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:1.0:1782241629.291986:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b865 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.292008:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b865 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.292023:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b865 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.292090:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b865 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.292098:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b865 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.292130:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b865 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.292137:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164cc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241629.292143:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b865 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.292153:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b865 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.292170:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241629.292174:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241629.292180:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b865 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.292187:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b865 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241629.292302:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+20:18783:x1868815120107776:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 414us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241629.292312:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 41 00000100:00100000:0.0:1782241629.301828:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241629.304636:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120108032 00000100:00100000:3.0:1782241629.304658:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120108032 00000100:00100000:3.0:1782241629.304800:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:3.0:1782241629.304815:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+20:18783:x1868815120108032:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:3.0:1782241629.305815:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+21:18783:x1868815120108032:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 998us (3997us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1782241629.305829:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00000040:00080000:2.0:1782241629.386721:0:22647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782241629.764533:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241629.765628:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120108288 00000100:00100000:0.0:1782241629.765647:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120108288 00000100:00100000:0.0:1782241629.765812:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 42 00000100:00100000:0.0:1782241629.765827:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+21:18814:x1868815120108288:12345-192.168.204.58@tcp:101:cat.0 00010000:00010000:0.0:1782241629.765865:0:24571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241629.765894:0:24571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861400/0xc9959f2fb1e1b86c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505826 expref: -99 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241629.766874:0:24571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1b873 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241629.766899:0:24571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1b873 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241629.766916:0:24571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1b873 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241629.766930:0:24571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782241629.769435:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861400/0xc9959f2fb1e1b86c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505826 expref: 24 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241629.769898:0:24571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1b873 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505826 expref: 23 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241629.769940:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:0.0:1782241629.769945:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782241629.769950:0:24571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860000, rc 0) 00000100:00100000:0.0:1782241629.770641:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+23:18814:x1868815120108288:12345-192.168.204.58@tcp:101:cat.0 Request processed in 4810us (6109us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1782241629.770654:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 42 00000100:00100000:2.0:1782241629.779076:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241629.783991:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120108416 00000100:00100000:0.0:1782241629.784015:0:22599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120108416 00000100:00100000:0.0:1782241629.784136:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 1 00000100:00100000:0.0:1782241629.784151:0:22599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+23:2397:x1868815120108416:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241629.784175:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241629.784235:0:22599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1b873 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505826 expref: 23 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241629.784469:0:22599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:0.0:1782241629.784487:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241629.784581:0:22599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+22:2397:x1868815120108416:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 432us (5519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241629.784591:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 1 00000100:00100000:3.0:1782241629.785459:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241629.788083:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120108672 00000100:00100000:1.0:1782241629.788105:0:22615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120108672 00000100:00100000:1.0:1782241629.788267:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:1.0:1782241629.788281:0:22615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+22:18814:x1868815120108672:12345-192.168.204.58@tcp:35:cat.0 00000100:00100000:1.0:1782241629.788960:0:22615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+23:18814:x1868815120108672:12345-192.168.204.58@tcp:35:cat.0 Request processed in 678us (3514us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1782241629.788972:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:3.0:1782241629.908551:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241629.908753:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120108928 00000100:00100000:1.0:1782241629.908816:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120108928 00000100:00100000:1.0:1782241629.908907:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 43 00000100:00100000:1.0:1782241629.908919:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+23:18820:x1868815120108928:12345-192.168.204.58@tcp:101:dd.0 00010000:00010000:1.0:1782241629.908954:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241629.908983:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b881 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350582d expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.909145:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b888 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.909164:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b888 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.909188:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b888 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241629.909203:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782241629.909501:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b881 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350582d expref: 26 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.909530:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b888 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350582d expref: 25 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.909540:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241629.909544:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241629.909548:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c800, rc 0) 00000100:00100000:1.0:1782241629.909633:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+25:18820:x1868815120108928:12345-192.168.204.58@tcp:101:dd.0 Request processed in 715us (1098us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1782241629.909664:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 43 00000100:00100000:2.0:1782241629.916384:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241629.923979:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120109056 00000100:00100000:1.0:1782241629.924003:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120109056 00000100:00100000:1.0:1782241629.924104:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:1.0:1782241629.924118:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+25:18820:x1868815120109056:12345-192.168.204.58@tcp:101:dd.0 00010000:00010000:1.0:1782241629.924153:0:22612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241629.924196:0:22612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b896 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505834 expref: -99 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.924254:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b89d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.924273:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b89d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.924287:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b89d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.924472:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b896 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505834 expref: 27 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.924496:0:22612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b89d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505834 expref: 26 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.924507:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241629.924510:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782241629.924515:0:22612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c310200, rc 0) 00000100:00100000:1.0:1782241629.924600:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+26:18820:x1868815120109056:12345-192.168.204.58@tcp:101:dd.0 Request processed in 485us (8242us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241629.924616:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:3.0:1782241629.925897:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241629.925959:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120109184 00000100:00100000:3.0:1782241629.925967:0:22597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120109184 00000100:00100000:3.0:1782241629.926035:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:3.0:1782241629.926045:0:22597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+26:2399:x1868815120109184:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241629.926061:0:22597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241629.926086:0:22597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b888 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350582d expref: 26 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241629.926107:0:22597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:3.0:1782241629.926111:0:22597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241629.926156:0:22597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+25:2399:x1868815120109184:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 112us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241629.926163:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:3.0:1782241629.936137:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241629.936235:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120109440 00000100:00100000:1.0:1782241629.936249:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120109440 00000100:00100000:1.0:1782241629.936337:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 45 00000100:00100000:1.0:1782241629.936348:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+25:18820:x1868815120109440:12345-192.168.204.58@tcp:36:dd.0 00010000:00010000:1.0:1782241629.936424:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241629.936459:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b83b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505811 expref: 25 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.936483:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241629.936489:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241629.936931:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.936950:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.936962:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782241629.937015:0:22613:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1782241629.937044:0:22613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7035675 reply state 0000000053684224 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.937058:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241629.937064:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241629.937067:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241629.937086:0:22613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241629.937208:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+27:18820:x1868815120109440:12345-192.168.204.58@tcp:36:dd.0 Request processed in 861us (1086us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1782241629.937216:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 45 00000020:00080000:1.0:1782241629.937223:0:22613:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782241629.957328:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241630.149541:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241630.155878:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120109696 00000100:00100000:3.0:1782241630.155901:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120109696 00000100:00100000:3.0:1782241630.156130:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:3.0:1782241630.156148:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+27:18820:x1868815120109696:12345-192.168.204.58@tcp:35:dd.0 00000100:00100000:3.0:1782241630.156516:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+28:18820:x1868815120109696:12345-192.168.204.58@tcp:35:dd.0 Request processed in 373us (6989us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1782241630.156526:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00080000:2.0:1782241630.159634:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241630.572069:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241630.572180:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120109824 00000100:00100000:1.0:1782241630.572193:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120109824 00000100:00100000:1.0:1782241630.572267:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 46 00000100:00100000:1.0:1782241630.572279:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+28:18835:x1868815120109824:12345-192.168.204.58@tcp:101:stat.0 00010000:00010000:1.0:1782241630.572310:0:22612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241630.572337:0:22612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8ab lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350583b expref: -99 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572435:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8b2 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572453:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8b2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572467:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8b2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572480:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8b9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572487:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572492:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572591:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8c0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572623:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572630:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241630.572687:0:22612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782241630.572692:0:22612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241630.572809:0:22612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572824:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572835:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8b2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572842:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8b2 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572849:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8b2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572856:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241630.572861:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8b2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572869:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8b2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572882:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:1.0:1782241630.572892:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241630.572898:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8b2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572905:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8b2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572922:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572928:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8b9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572934:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8b9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572940:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241630.572942:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8b9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572948:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8b9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572954:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff890e81fbc500) 00010000:00010000:1.0:1782241630.572957:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241630.572959:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8b9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572965:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8b9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.572993:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8ab lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350583b expref: 30 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.573019:0:22612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8c0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350583b expref: 29 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.573026:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241630.573029:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241630.573032:0:22612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c800, rc 0) 00000100:00100000:1.0:1782241630.573112:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+29:18835:x1868815120109824:12345-192.168.204.58@tcp:101:stat.0 Request processed in 836us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241630.573121:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 46 00000100:00100000:0.0:1782241630.721070:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241630.721938:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120110080 00000100:00100000:1.0:1782241630.721950:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120110080 00000100:00100000:1.0:1782241630.722112:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 47 00000100:00100000:1.0:1782241630.722124:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+29:18841:x1868815120110080:12345-192.168.204.58@tcp:36:truncate.0 00010000:00010000:1.0:1782241630.722190:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241630.722219:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8c0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350583b expref: 29 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.722243:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241630.722248:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241630.722423:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.722439:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.722451:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782241630.722519:0:22613:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1782241630.722540:0:22613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007af84f84 reply state 000000007efa9651 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.722553:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241630.722560:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241630.722563:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241630.722565:0:22613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241630.723471:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+31:18841:x1868815120110080:12345-192.168.204.58@tcp:36:truncate.0 Request processed in 1343us (2404us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1782241630.723481:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 47 00000020:00080000:1.0:1782241630.723487:0:22613:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782241630.986523:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241631.031715:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.031873:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120110208 00000100:00100000:1.0:1782241631.031884:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120110208 00000100:00100000:1.0:1782241631.031941:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 48 00000100:00100000:1.0:1782241631.031951:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+31:18855:x1868815120110208:12345-192.168.204.58@tcp:101:stat.0 00010000:00010000:1.0:1782241631.031975:0:22612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241631.031994:0:22612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ce lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505842 expref: -99 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032056:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b8d5 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032071:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b8d5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032098:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b8d5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032123:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8dc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032132:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032139:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032226:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032234:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032241:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241631.032282:0:22612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1782241631.032286:0:22612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241631.032303:0:22612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032313:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032320:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b8d5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032325:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b8d5 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032353:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b8d5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032359:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164cc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241631.032363:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b8d5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032371:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b8d5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032384:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:1.0:1782241631.032387:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241631.032391:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b8d5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032397:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b8d5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032412:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032417:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8dc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032422:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8dc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032427:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241631.032429:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8dc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032444:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8dc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032451:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff890e81fbc500) 00010000:00010000:1.0:1782241631.032454:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241631.032456:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8dc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032461:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8dc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032484:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ce lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505842 expref: 33 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032496:0:22612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505842 expref: 32 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.032502:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241631.032504:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241631.032506:0:22612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c311800, rc 0) 00000100:00100000:1.0:1782241631.032571:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+32:18855:x1868815120110208:12345-192.168.204.58@tcp:101:stat.0 Request processed in 621us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241631.032580:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 48 00000100:00100000:0.0:1782241631.202280:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.202814:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120110464 00000100:00100000:2.0:1782241631.202824:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120110464 00000100:00100000:2.0:1782241631.202895:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 49 00000100:00100000:2.0:1782241631.202905:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+32:18865:x1868815120110464:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241631.202927:0:22611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241631.202948:0:22611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b8ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505849 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241631.203057:0:22611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782241631.203324:0:22611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b8ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505849 expref: 34 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.203348:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195d300) 00010000:00010000:2.0:1782241631.203351:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241631.203356:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b8ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505849 expref: 34 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.203389:0:22611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43faca00, rc 0) 00000100:00100000:2.0:1782241631.203493:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+33:18865:x1868815120110464:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 588us (1222us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1782241631.203500:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 49 00000100:00100000:3.0:1782241631.210597:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241631.211121:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120110720 00000100:00100000:0.0:1782241631.211133:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120110720 00000100:00100000:0.0:1782241631.211205:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:0.0:1782241631.211239:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477e0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+33:18865:x1868815120110720:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:0.0:1782241631.211572:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477e0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+34:18865:x1868815120110720:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 344us (984us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1782241631.211611:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:0.0:1782241631.354441:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.354585:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120110976 00000100:00100000:1.0:1782241631.354596:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120110976 00000100:00100000:1.0:1782241631.354663:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:1.0:1782241631.354672:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+34:18871:x1868815120110976:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241631.354728:0:22612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241631.354749:0:22612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8f8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505850 expref: -99 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.354902:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.354919:0:22612:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b826 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350580a expref: 35 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.354926:0:22612:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505842 expref: 35 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.354935:0:22612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.354968:0:22612:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505842 expref: 35 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.354982:0:22612:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505842 expref: 35 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241631.354996:0:22612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22612:1868815140137472:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241631.355096:0:22612:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b826 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350580a expref: 35 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.355107:0:22612:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b826 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350580a expref: 35 pid: 22611 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241631.355129:0:22612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22612:1868815140137600:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241631.355163:0:22612:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e508a5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241631.364904:0:22612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22612:1868815140137472:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241631.364922:0:22612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22612:1868815140137600:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241631.364949:0:22612:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241631.366165:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241631.366203:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.366361:0:23768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120111104 00000100:00100000:2.0:1782241631.366369:0:23768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120111104 00010000:00010000:2.0:1782241631.366412:0:23768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505842 expref: 36 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241631.366449:0:23768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120111232 00000100:00100000:2.0:1782241631.366452:0:23768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120111232 00010000:00010000:2.0:1782241631.366466:0:23768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b826 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350580a expref: 37 pid: 22611 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241631.366493:0:23768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:2.0:1782241631.366502:0:23768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e50599050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+37:2399:x1868815120111104:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241631.366517:0:23768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241631.366524:0:23768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505842 expref: 37 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.366537:0:23768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505842 expref: 37 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.366559:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311800/0xc9959f2fb1e1b8e3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505842 expref: 37 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.366604:0:23768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241631.366611:0:23768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.366620:0:23768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.366627:0:23768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241631.366673:0:23768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e50599050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+36:2399:x1868815120111104:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 172us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.366693:0:23768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:2.0:1782241631.366749:0:23768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:2.0:1782241631.366798:0:23768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+35:2399:x1868815120111232:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241631.366807:0:23768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241631.366812:0:23768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b826 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350580a expref: 35 pid: 22611 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.366823:0:23768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b826 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350580a expref: 35 pid: 22611 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.366835:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b826 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350580a expref: 35 pid: 22611 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.366845:0:23768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241631.366848:0:23768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.366866:0:23768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.366873:0:23768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.366895:0:23768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241631.366917:0:23768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+34:2399:x1868815120111232:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 162us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.366924:0:23768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00010000:00010000:1.0:1782241631.367258:0:22612:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.367268:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241631.367288:0:22612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1782241631.367419:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310800/0xc9959f2fb1e1b8f8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505850 expref: 35 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.367432:0:22612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505850 expref: 34 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.367439:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241631.367441:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782241631.367443:0:22612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c800, rc 0) 00000100:00100000:1.0:1782241631.367469:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+34:18871:x1868815120110976:12345-192.168.204.58@tcp:101:bash.0 Request processed in 12800us (13041us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1782241631.367475:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:2.0:1782241631.372185:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.372261:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120111488 00000100:00100000:1.0:1782241631.372270:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120111488 00000100:00100000:1.0:1782241631.372329:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 51 00000100:00100000:1.0:1782241631.372349:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+34:18871:x1868815120111488:12345-192.168.204.58@tcp:36:bash.0 00010000:00010000:1.0:1782241631.372581:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.372598:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.372607:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782241631.372649:0:22613:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1782241631.372671:0:22613:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cfc9a792 reply state 0000000022cc5c6c transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.372683:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.372691:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241631.372694:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241631.372697:0:22613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241631.372818:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+37:18871:x1868815120111488:12345-192.168.204.58@tcp:36:bash.0 Request processed in 470us (640us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1782241631.372825:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 51 00000020:00080000:1.0:1782241631.372830:0:22613:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782241631.376409:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241631.376500:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120111616 00000100:00100000:0.0:1782241631.376509:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120111616 00000100:00100000:0.0:1782241631.376564:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:0.0:1782241631.376582:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+37:18871:x1868815120111616:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:0.0:1782241631.376602:0:24571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241631.376621:0:24571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1b914 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505857 expref: -99 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.376674:0:24571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1b914 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505857 expref: 38 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.376699:0:24571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1b914 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505857 expref: 38 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.376723:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:0.0:1782241631.376727:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782241631.376730:0:24571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860800, rc 0) 00000100:00100000:0.0:1782241631.376811:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+38:18871:x1868815120111616:12345-192.168.204.58@tcp:101:bash.0 Request processed in 238us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241631.376818:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:0.0:1782241631.385893:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.386142:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120111744 00000100:00100000:1.0:1782241631.386160:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120111744 00000100:00100000:1.0:1782241631.386266:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:1.0:1782241631.386276:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+38:18871:x1868815120111744:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241631.386314:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241631.386345:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b91b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350585e expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.386443:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b922 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.386458:0:22613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505850 expref: 39 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.386467:0:22613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b922 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.386500:0:22613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505850 expref: 39 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.386513:0:22613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505850 expref: 39 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241631.386526:0:22613:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22613:1868815140137728:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241631.386623:0:22613:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e508a5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241631.391109:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241631.391347:0:22598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120111872 00000100:00100000:3.0:1782241631.391356:0:22598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120111872 00010000:00010000:3.0:1782241631.391394:0:22598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505850 expref: 40 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241631.391439:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:3.0:1782241631.391450:0:22598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+40:2398:x1868815120111872:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241631.391465:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241631.391471:0:22598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505850 expref: 40 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.391484:0:22598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505850 expref: 40 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.391508:0:22598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:3.0:1782241631.391514:0:22598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b922 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.391524:0:22598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b922 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.391546:0:22598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b922 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.391565:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241631.391628:0:22598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+40:2398:x1868815120111872:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 179us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.391636:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00010000:00010000:1.0:1782241631.391924:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b8ff lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505850 expref: 39 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241631.391942:0:22613:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22613:1868815140137728:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241631.391962:0:22613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b922 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.391983:0:22613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b922 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.391990:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b922 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241631.392056:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782241631.392061:0:22613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241631.392093:0:22613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b922 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.392123:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b91b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350585e expref: 39 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.392138:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b922 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350585e expref: 38 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.392146:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241631.392162:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241631.392165:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e821c3200, rc 0) 00000100:00100000:1.0:1782241631.392191:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+38:18871:x1868815120111744:12345-192.168.204.58@tcp:101:bash.0 Request processed in 5917us (6309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241631.392199:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:3.0:1782241631.396344:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241631.396425:0:25646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120112128 00000100:00100000:0.0:1782241631.396435:0:25646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120112128 00000100:00100000:0.0:1782241631.396499:0:25646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:0.0:1782241631.396508:0:25646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+38:18871:x1868815120112128:12345-192.168.204.58@tcp:103:bash.0 00010000:00010000:0.0:1782241631.396524:0:25646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782241631.396549:0:25646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1b914 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505857 expref: 38 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.396581:0:25646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b922 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350585e expref: 37 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.396594:0:25646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:0.0:1782241631.396601:0:25646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241631.396656:0:25646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+36:18871:x1868815120112128:12345-192.168.204.58@tcp:103:bash.0 Request processed in 149us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241631.396664:0:25646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:3.0:1782241631.400338:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.401471:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120112256 00000100:00100000:1.0:1782241631.401482:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120112256 00000100:00100000:1.0:1782241631.401550:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:1.0:1782241631.401561:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+36:18871:x1868815120112256:12345-192.168.204.58@tcp:58:bash.0 00010000:00010000:1.0:1782241631.402045:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.402093:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.402106:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782241631.403268:0:22613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241631.403303:0:22613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1782241631.403943:0:22613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1782241631.404104:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+36:18871:x1868815120112256:12345-192.168.204.58@tcp:58:bash.0 Request processed in 2541us (3780us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241631.404117:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:3.0:1782241631.407201:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.407276:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120112384 00000100:00100000:2.0:1782241631.407286:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120112384 00000100:00100000:2.0:1782241631.407353:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 55 00000100:00100000:2.0:1782241631.407364:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+36:18871:x1868815120112384:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241631.407384:0:22611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241631.407403:0:22611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b930 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505865 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.407459:0:22611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.407469:0:22611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b930 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505865 expref: 37 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.407488:0:22611:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.407520:0:22611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b930 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505865 expref: 37 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.407532:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241631.407535:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782241631.407538:0:22611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b930 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505865 expref: 37 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.407545:0:22611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad200, rc 0) 00000100:00100000:2.0:1782241631.408191:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+37:18871:x1868815120112384:12345-192.168.204.58@tcp:101:bash.0 Request processed in 825us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.408201:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 55 00000040:00080000:2.0:1782241631.429084:0:22647:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1782241631.429093:0:22647:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782241631.429143:0:22647:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1782241631.429167:0:22647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1782241631.430437:0:22647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22647:1868815140137856:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782241631.430535:0:22647:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d87480 going to sleep for 11 seconds 00000100:00100000:2.0:1782241631.436114:0:22647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22647:1868815140137856:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782241631.442530:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241631.442754:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120112512 00000100:00100000:3.0:1782241631.442782:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120112512 00000100:00100000:3.0:1782241631.442890:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:3.0:1782241631.442903:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+37:18872:x1868815120112512:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782241631.442933:0:24571:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782241631.443052:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+37:18872:x1868815120112512:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 151us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.443061:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:0.0:1782241631.447993:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.448065:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120112640 00000100:00100000:1.0:1782241631.448085:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120112640 00000100:00100000:1.0:1782241631.448143:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:1.0:1782241631.448162:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+37:18872:x1868815120112640:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782241631.448237:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b937 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448254:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b937 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448265:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b937 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448280:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b93e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448288:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b93e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448308:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b93e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448341:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b945 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448350:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b945 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448358:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b945 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241631.448407:0:22612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782241631.448411:0:22612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241631.448424:0:22612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b945 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448435:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b937 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448441:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b937 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448448:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b937 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448455:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c2200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241631.448460:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b937 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448468:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b937 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448487:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890d4195eb00) 00010000:00010000:1.0:1782241631.448491:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241631.448495:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b937 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448502:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b937 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448517:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b93e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448523:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b93e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448530:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b93e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448535:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c2800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241631.448538:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b93e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448544:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b93e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448550:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff890e81fbce00) 00010000:00010000:1.0:1782241631.448552:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241631.448554:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b93e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448559:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b93e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448585:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b945 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448591:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b945 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448597:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b945 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448602:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c2000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241631.448605:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b945 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448611:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b945 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448618:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241631.448620:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241631.448623:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b945 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.448628:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b945 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241631.448863:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+37:18872:x1868815120112640:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 Request processed in 701us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241631.448872:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:0.0:1782241631.452103:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.452177:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120112896 00000100:00100000:1.0:1782241631.452186:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120112896 00000100:00100000:1.0:1782241631.452243:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:1.0:1782241631.452265:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+37:18872:x1868815120112896:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241631.452286:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241631.452306:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b94c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350586c expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452422:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b953 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452438:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b953 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452450:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b953 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241631.452461:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782241631.452536:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b953 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452544:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b953 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452552:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b953 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452558:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241631.452563:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b953 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452582:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b953 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452594:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241631.452603:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241631.452608:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b953 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452614:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1b953 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452654:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b94c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350586c expref: 39 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452664:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890d4195eb00) 00010000:00010000:1.0:1782241631.452666:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241631.452670:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b94c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350586c expref: 39 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.452896:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e821c3200, rc 0) 00000100:00100000:1.0:1782241631.452950:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+38:18872:x1868815120112896:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 687us (857us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1782241631.452959:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:0.0:1782241631.456746:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.456986:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120113024 00000100:00100000:1.0:1782241631.456997:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120113024 00000100:00100000:1.0:1782241631.457054:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:1.0:1782241631.457064:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+38:18872:x1868815120113024:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782241631.457112:0:22612:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782241631.457265:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+38:18872:x1868815120113024:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 202us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241631.457273:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:0.0:1782241631.460978:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.461044:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120113280 00000100:00100000:1.0:1782241631.461065:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120113280 00000100:00100000:1.0:1782241631.461119:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 60 00000100:00100000:1.0:1782241631.461129:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+38:18872:x1868815120113280:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241631.461161:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241631.461181:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b961 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505873 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782241631.461582:0:22613:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:1.0:1782241631.461589:0:22613:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1782241631.461611:0:22613:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:1.0:1782241631.462493:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b968 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.462510:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b968 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.462522:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b968 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.462597:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1b961 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505873 expref: 41 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.462620:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b968 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505873 expref: 40 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.462628:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:1.0:1782241631.462631:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241631.462634:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e821c2000, rc 0) 00000100:00100000:1.0:1782241631.463557:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+40:18872:x1868815120113280:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 2422us (2580us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1782241631.463593:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 60 00000100:00100000:0.0:1782241631.468107:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.468250:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120113536 00000100:00100000:1.0:1782241631.468259:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120113536 00000100:00100000:1.0:1782241631.468321:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:1.0:1782241631.468339:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+40:18872:x1868815120113536:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782241631.468397:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241631.468423:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b968 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505873 expref: 40 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468443:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:1.0:1782241631.468453:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241631.468474:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b976 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468489:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b976 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468499:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b976 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468514:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b97d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xebfb8d6f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468521:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b97d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xebfb8d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468529:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b97d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xebfb8d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468595:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b976 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468602:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b976 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468608:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b976 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468614:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c3200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241631.468618:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b976 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468625:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b976 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468635:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:1.0:1782241631.468637:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241631.468642:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b976 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468647:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b976 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468657:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b97d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xebfb8d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468663:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b97d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xebfb8d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468668:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b97d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xebfb8d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468680:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c2800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241631.468683:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b97d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xebfb8d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468689:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b97d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xebfb8d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468698:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xebfb8d6f (ffff890e81fbcb00) 00010000:00010000:1.0:1782241631.468701:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241631.468704:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b97d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xebfb8d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.468711:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b97d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xebfb8d6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241631.468817:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+39:18872:x1868815120113536:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 487us (717us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782241631.468824:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:0.0:1782241631.472040:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241631.472429:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120113664 00000100:00100000:3.0:1782241631.472440:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120113664 00000100:00100000:3.0:1782241631.472498:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 62 00000100:00100000:3.0:1782241631.472508:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+39:18872:x1868815120113664:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241631.472529:0:24571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241631.472553:0:24571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b984 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350587a expref: -99 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.472619:0:24571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b98b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.472633:0:24571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b98b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.472644:0:24571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b98b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.472811:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b984 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350587a expref: 41 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.472829:0:24571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1b98b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350587a expref: 40 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.472838:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890d4195e400) 00010000:00010000:3.0:1782241631.472841:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782241631.472844:0:24571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea000, rc 0) 00000100:00100000:3.0:1782241631.472895:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+40:18872:x1868815120113664:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 387us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.472902:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 62 00000100:00100000:0.0:1782241631.476167:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.476400:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120113920 00000100:00100000:1.0:1782241631.476410:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120113920 00000100:00100000:1.0:1782241631.476470:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:1.0:1782241631.476481:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+40:18872:x1868815120113920:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782241631.476563:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.476578:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.476589:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782241631.476826:0:22612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1782241631.476838:0:22612:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 694735080361ns, next at 695735076917ns, rc = 0 00000004:00010000:1.0:1782241631.476886:0:22612:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017f75440 reply state 000000007afe14e4 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.476900:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.476908:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890d4195e400) 00010000:00010000:1.0:1782241631.476912:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1782241631.476915:0:22612:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241631.476995:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+42:18872:x1868815120113920:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 515us (844us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1782241631.477003:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:0.0:1782241631.479976:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241631.480068:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120114048 00000100:00100000:3.0:1782241631.480077:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120114048 00000100:00100000:3.0:1782241631.480133:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 64 00000100:00100000:3.0:1782241631.480143:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+42:18872:x1868815120114048:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241631.480177:0:24571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241631.480196:0:24571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b999 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505881 expref: -99 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.480255:0:24571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b999 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505881 expref: 43 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.480271:0:24571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b999 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505881 expref: 43 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.480290:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890d4195e400) 00010000:00010000:3.0:1782241631.480293:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241631.480297:0:24571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb800, rc 0) 00000100:00100000:3.0:1782241631.480352:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+43:18872:x1868815120114048:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 210us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.480360:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 64 00000100:00100000:0.0:1782241631.483506:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.483681:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120114176 00000100:00100000:1.0:1782241631.483692:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120114176 00000100:00100000:1.0:1782241631.483795:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:1.0:1782241631.483805:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2398:x1868815120114176:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1782241631.484022:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:2398:x1868815120114176:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 217us (526us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1782241631.484030:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00080000:2.0:1782241631.484426:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241631.486521:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241631.486613:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120114432 00000100:00100000:3.0:1782241631.486624:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120114432 00000100:00100000:3.0:1782241631.486679:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:3.0:1782241631.486688:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+43:18872:x1868815120114432:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782241631.486940:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+44:18872:x1868815120114432:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 252us (425us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1782241631.486947:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:0.0:1782241631.489461:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.489547:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120114688 00000100:00100000:1.0:1782241631.489555:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120114688 00000100:00100000:1.0:1782241631.489623:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:1.0:1782241631.489634:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+44:18872:x1868815120114688:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782241631.489734:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+44:18872:x1868815120114688:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 102us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241631.489782:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:0.0:1782241631.492930:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.493056:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241631.493085:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140137984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241631.493133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241631.493183:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140137984 00000100:00100000:2.0:1782241631.493190:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140137984 00000100:00100000:2.0:1782241631.493250:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782241631.493259:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140137984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782241631.493288:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241631.493339:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140137984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.493347:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1782241631.493370:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241631.493412:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140137984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241631.493708:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120114816 00000100:00100000:1.0:1782241631.493714:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120114816 00000100:00100000:1.0:1782241631.493751:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:1.0:1782241631.493775:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+44:18872:x1868815120114816:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241631.493787:0:24571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241631.493807:0:24571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9a0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505888 expref: -99 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.493877:0:24571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b9a7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.493892:0:24571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b9a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.493904:0:24571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b9a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241631.493947:0:24571:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241631.493964:0:24571:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b9a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.493989:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9a0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505888 expref: 46 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.494007:0:24571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b9a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505888 expref: 45 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.494016:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890d4195e400) 00010000:00010000:1.0:1782241631.494029:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782241631.494033:0:24571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e821c2000, rc 0) 00000100:00100000:1.0:1782241631.494072:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+45:18872:x1868815120114816:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 314us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241631.494438:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:0.0:1782241631.494913:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140138368:0@lo:400:kworker.0 00000100:00100000:0.0:1782241631.494955:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241631.494974:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140138880:0@lo:400:kworker.0 00000100:00100000:0.0:1782241631.494992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241631.495003:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815140139392:0@lo:400:kworker.0 00000100:00100000:0.0:1782241631.495024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241631.495039:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782241631.495045:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140138240:0@lo:400:kworker.0 00000100:00100000:0.0:1782241631.495063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241631.495158:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140138752:0@lo:400:kworker.0 00000100:00100000:0.0:1782241631.495180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241631.495196:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140139264:0@lo:400:kworker.0 00000100:00100000:0.0:1782241631.495214:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241631.495236:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140138240 00000100:00100000:0.0:1782241631.495241:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140138240 00000100:00100000:0.0:1782241631.495268:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140138752 00000100:00100000:0.0:1782241631.495270:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140138752 00000100:00100000:0.0:1782241631.495283:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782241631.495290:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140138240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241631.495328:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140138240:12345-0@lo:400:kworker.0 Request processed in 38us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.495431:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140138368 00000100:00100000:2.0:1782241631.495435:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140138368 00000100:00100000:2.0:1782241631.495464:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140138880 00000100:00100000:2.0:1782241631.495467:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140138880 00000100:00100000:2.0:1782241631.495483:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782241631.495490:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140138368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241631.495523:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140138368:12345-0@lo:400:kworker.0 Request processed in 34us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.495529:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782241631.495543:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782241631.495549:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140138880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241631.495574:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140138880:12345-0@lo:400:kworker.0 Request processed in 25us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.495592:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782241631.495610:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782241631.495617:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140138752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241631.495645:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140138752:12345-0@lo:400:kworker.0 Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.495666:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1782241631.495683:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241631.495693:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23eacdb9-0e56-4c3a-b421-5efac43515c0:3640:1868815140138112:0@lo:400:kworker.0 00000100:00100000:2.0:1782241631.495720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241631.495739:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140138624:0@lo:400:kworker.0 00000100:00100000:2.0:1782241631.495778:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241631.495792:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140139136:0@lo:400:kworker.0 00000100:00100000:2.0:1782241631.495810:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241631.495821:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1782241631.495826:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140138496:0@lo:400:kworker.0 00000100:00100000:2.0:1782241631.495845:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241631.495860:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140139008:0@lo:400:kworker.0 00000100:00100000:2.0:1782241631.495879:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241631.495889:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140139520:0@lo:400:kworker.0 00000100:00100000:2.0:1782241631.495909:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241631.495925:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140138496 00000100:00100000:2.0:1782241631.495928:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140138496 00000100:00100000:2.0:1782241631.495949:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782241631.495954:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140138496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241631.495983:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140138496:12345-0@lo:400:kworker.0 Request processed in 28us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.495989:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1782241631.496000:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241631.496021:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140138496:0@lo:400:kworker.0 00000100:00100000:2.0:1782241631.496041:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140139392 00000100:00100000:2.0:1782241631.496049:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140139392 00000100:00080000:2.0:1782241631.496062:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241631.496178:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782241631.496215:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140138240:0@lo:400:kworker.0 00000100:00100000:0.0:1782241631.496224:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140138752:0@lo:400:kworker.0 00000100:00100000:0.0:1782241631.496234:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140138368:0@lo:400:kworker.0 00000100:00100000:0.0:1782241631.496243:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140138880:0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.496452:0:22605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140138112 00000100:00100000:3.0:1782241631.496457:0:22605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140138112 00000100:00100000:3.0:1782241631.496493:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1782241631.496500:0:22605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3640:x1868815140138112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.496541:0:22605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23eacdb9-0e56-4c3a-b421-5efac43515c0+24:3640:x1868815140138112:12345-0@lo:400:kworker.0 Request processed in 42us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.496558:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1782241631.496620:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23eacdb9-0e56-4c3a-b421-5efac43515c0:3640:1868815140138112:0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.496639:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140139264 00000100:00100000:3.0:1782241631.496642:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140139264 00000100:00100000:3.0:1782241631.496666:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140138624 00000100:00100000:3.0:1782241631.496669:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140138624 00000100:00100000:3.0:1782241631.496679:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140139136 00000100:00100000:3.0:1782241631.496682:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140139136 00000100:00100000:3.0:1782241631.496693:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140139008 00000100:00100000:3.0:1782241631.496695:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140139008 00000100:00100000:3.0:1782241631.496704:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140139520 00000100:00100000:3.0:1782241631.496707:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140139520 00000100:00100000:3.0:1782241631.496721:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782241631.496728:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815140139392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.496782:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815140139392:12345-0@lo:400:kworker.0 Request processed in 54us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.496788:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782241631.496800:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782241631.496806:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815140139264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.496832:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815140139264:12345-0@lo:400:kworker.0 Request processed in 27us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.496838:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782241631.496849:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782241631.496854:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140138624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.496883:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140138624:12345-0@lo:400:kworker.0 Request processed in 29us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.496889:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782241631.496908:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782241631.496914:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140139136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.496940:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140139136:12345-0@lo:400:kworker.0 Request processed in 27us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.496947:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782241631.496957:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782241631.496962:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140139008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.496998:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140139008:12345-0@lo:400:kworker.0 Request processed in 36us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.497005:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782241631.497016:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782241631.497022:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140139520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.497044:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140139520:12345-0@lo:400:kworker.0 Request processed in 23us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.497050:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1782241631.497063:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241631.497067:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1782241631.497529:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d477f8380 x1868815140139264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241631.497544:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140139264:0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.497556:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815140139392:0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.497601:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140139008:0@lo:400:kworker.0 00010000:00080000:3.0:1782241631.497615:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d477fbb80 x1868815140139520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241631.497637:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140139520:0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.497651:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140138624:0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.497662:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140139136:0@lo:400:kworker.0 00000100:00100000:3.0:1782241631.498136:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140139648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241631.498191:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241631.498317:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140139648 00000100:00100000:2.0:1782241631.498323:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140139648 00000100:00100000:2.0:1782241631.498436:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782241631.498444:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140139648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782241631.498468:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241631.498515:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140139648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.498522:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782241631.498606:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140139648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241631.502236:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.502354:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120114944 00000100:00100000:2.0:1782241631.502363:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120114944 00000100:00100000:2.0:1782241631.502420:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:2.0:1782241631.502430:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+6:2399:x1868815120114944:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782241631.502448:0:24572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241631.502471:0:24572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350588f expref: -99 pid: 24572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241631.502495:0:24572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3ad95f, blocks: 0x0 00010000:00010000:2.0:1782241631.502513:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=694s v=(0 0) 00010000:00010000:2.0:1782241631.502517:0:24572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241631.502527:0:24572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350588f expref: 7 pid: 24572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.502544:0:24572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350588f expref: 7 pid: 24572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.502585:0:24572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac400, rc 0) 00000100:00100000:2.0:1782241631.502648:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:2399:x1868815120114944:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 219us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.502656:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:0.0:1782241631.506470:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241631.506650:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120115200 00000100:00100000:3.0:1782241631.506660:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120115200 00000100:00100000:3.0:1782241631.506717:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:3.0:1782241631.506727:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+45:18872:x1868815120115200:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782241631.506856:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+45:18872:x1868815120115200:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 130us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.506864:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:1.0:1782241631.510264:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.510360:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120115328 00000100:00100000:2.0:1782241631.510369:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120115328 00000100:00100000:2.0:1782241631.510427:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 68 00000100:00100000:2.0:1782241631.510439:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+45:18872:x1868815120115328:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782241631.512364:0:22592:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:3.0:1782241631.512379:0:22592:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1782241631.512609:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140139776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782241631.512673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241631.512723:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140139776 00000100:00100000:0.0:1782241631.512729:0:24124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140139776 00000100:00100000:0.0:1782241631.512791:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782241631.512799:0:24124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140139776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1782241631.512933:0:24124:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782241631.512937:0:24124:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1782241631.512940:0:24124:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782241631.512942:0:24124:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1782241631 -> 1782241631 00002000:00010000:0.0:1782241631.512945:0:24124:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1782241631.512981:0:24124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140139776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 182us (308us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1782241631.512989:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1782241631.513028:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890e47ae9c00/2, rc 0, transno 12884901892 00000100:00100000:0.0:1782241631.513033:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140139776:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1782241631.513252:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513263:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513271:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513279:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241631.513285:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513295:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513314:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff890d4195ee00) 00010000:00010000:2.0:1782241631.513317:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241631.513330:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513346:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1b770 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513366:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513373:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513379:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513384:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241631.513387:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513392:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513400:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:2.0:1782241631.513402:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241631.513405:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513411:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1b777 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513423:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513430:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513441:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513448:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241631.513450:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513456:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513464:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff890e81fbc500) 00010000:00010000:2.0:1782241631.513466:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241631.513469:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513475:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1b81f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513491:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513497:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513502:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513508:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241631.513510:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513527:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513537:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241631.513539:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241631.513542:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513547:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311000/0xc9959f2fb1e1b8a4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513559:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513577:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513583:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513588:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241631.513591:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513598:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513605:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241631.513608:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241631.513611:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513626:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1b8c7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513637:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513643:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513648:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513653:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164cc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241631.513658:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513663:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513671:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241631.513673:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241631.513676:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513682:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164cc00/0xc9959f2fb1e1b90d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513691:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513696:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513710:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513715:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c2800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241631.513719:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513726:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513734:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890d4195e400) 00010000:00010000:2.0:1782241631.513736:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782241631.513740:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.513746:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b992 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782241631.513884:0:22592:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1782241631.514614:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+14:18872:x1868815120115328:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 Request processed in 4172us (4354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.514624:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 68 00010000:00010000:1.0:1782241631.515990:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.516004:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.516011:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.516017:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861c00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241631.516022:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.516030:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.516045:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:1.0:1782241631.516048:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1782241631.516052:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.516059:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861c00/0xc9959f2fb1e1b7c4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241631.517975:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.518059:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120115456 00000100:00100000:2.0:1782241631.518067:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120115456 00000100:00100000:2.0:1782241631.518123:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:2.0:1782241631.518132:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:2398:x1868815120115456:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1782241631.518250:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:2398:x1868815120115456:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 Request processed in 118us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.518258:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:0.0:1782241631.521530:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241631.521619:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120115712 00000100:00100000:3.0:1782241631.521628:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120115712 00000100:00100000:3.0:1782241631.521687:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:3.0:1782241631.521696:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+14:18872:x1868815120115712:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782241631.521748:0:22611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241631.521810:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2000/0xc9959f2fb1e1b9a7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505888 expref: 14 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.521830:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890d4195e400) 00010000:00010000:3.0:1782241631.521844:0:22611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241631.521877:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b9b5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.521892:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b9b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.521903:0:22611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b9b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782241631.522018:0:22611:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000590d5b6b reply state 00000000da784e2d transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b9b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.522031:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1b9b5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.522038:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890d4195e400) 00010000:00010000:3.0:1782241631.522042:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782241631.522044:0:22611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782241631.522262:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+15:18872:x1868815120115712:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 566us (738us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1782241631.522270:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:1.0:1782241631.525307:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241631.525520:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120115840 00000100:00100000:0.0:1782241631.525530:0:24124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120115840 00000100:00100000:0.0:1782241631.525590:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:0.0:1782241631.525600:0:24124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:18872:x1868815120115840:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241631.525618:0:24124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241631.525635:0:24124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505896 expref: -99 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.525666:0:24124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350588f expref: 8 pid: 24572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.525675:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241631.525679:0:24124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241631.525685:0:24124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 8 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.525718:0:24124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350588f expref: 8 pid: 24572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.525732:0:24124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350588f expref: 8 pid: 24572 timeout: 794 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241631.525746:0:24124:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24124:1868815140139904:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241631.525854:0:24124:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e778fcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241631.529257:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241631.529378:0:24124:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24124:1868815140139904:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241631.529412:0:24124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 8 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.529433:0:24124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860000, rc 0) 00000100:00100000:3.0:1782241631.529490:0:24124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+8:18872:x1868815120115840:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 3891us (4190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241631.529509:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:2.0:1782241631.530025:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120115968 00000100:00100000:2.0:1782241631.530032:0:22597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120115968 00010000:00010000:2.0:1782241631.530062:0:22597:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350588f expref: 8 pid: 24572 timeout: 794 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241631.530095:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:2.0:1782241631.530104:0:22597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+8:2399:x1868815120115968:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241631.530117:0:22597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241631.530137:0:22597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350588f expref: 8 pid: 24572 timeout: 794 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.530162:0:22597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350588f expref: 8 pid: 24572 timeout: 794 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.530187:0:22597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350588f expref: 8 pid: 24572 timeout: 794 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.530202:0:22597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241631.530206:0:22597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241631.530213:0:22597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 7 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.530224:0:22597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 7 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.530257:0:22597:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 7 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241631.530279:0:22597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22597:1868815140140032:192.168.204.58@tcp:105: 00000100:00100000:2.0:1782241631.530354:0:22597:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d87480 going to sleep for 11 seconds 00000100:00100000:2.0:1782241631.533936:0:22597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22597:1868815140140032:192.168.204.58@tcp:105: 00010000:00010000:2.0:1782241631.533965:0:22597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241631.534032:0:22597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:2399:x1868815120115968:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 3928us (4784us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.534043:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:0.0:1782241631.540128:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.540196:0:24572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120116096 00000100:00100000:2.0:1782241631.540206:0:24572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120116096 00000100:00100000:2.0:1782241631.540264:0:24572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:2.0:1782241631.540274:0:24572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:2398:x1868815120116096:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1782241631.540434:0:24572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782241631.540437:0:24572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1782241631 00002000:00010000:2.0:1782241631.540440:0:24572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1782241629 00002000:00010000:2.0:1782241631.540442:0:24572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1782241631 -> 1782241631 00002000:00010000:2.0:1782241631.540444:0:24572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782241631.540506:0:24572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+8:2398:x1868815120116096:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 233us (386us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1782241631.540514:0:24572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:1.0:1782241631.543443:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.543639:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120116224 00000100:00100000:2.0:1782241631.543648:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120116224 00000100:00100000:2.0:1782241631.543743:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:2.0:1782241631.543789:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+8:2397:x1868815120116224:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782241631.543860:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.543881:0:24123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 8 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.543890:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241631.543894:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782241631.543897:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.543930:0:24123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 8 pid: 24124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.543944:0:24123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 8 pid: 24124 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241631.543958:0:24123:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24123:1868815140140160:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241631.544036:0:24123:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d87480 going to sleep for 11 seconds 00000100:00100000:2.0:1782241631.547111:0:24123:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24123:1868815140140160:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241631.547143:0:24123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241631.547221:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.547375:0:23768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120116352 00000100:00100000:2.0:1782241631.547382:0:23768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120116352 00010000:00010000:2.0:1782241631.547582:0:23768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 9 pid: 24124 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241631.547619:0:23768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:2.0:1782241631.547629:0:23768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+9:2399:x1868815120116352:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241631.547644:0:23768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241631.547726:0:23768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 9 pid: 24124 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.547740:0:23768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 9 pid: 24124 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.547802:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1b9bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505896 expref: 9 pid: 24124 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.547820:0:23768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782241631.547836:0:23768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782241631.547842:0:23768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.547853:0:23768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.547959:0:23768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241631.548010:0:23768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+8:2399:x1868815120116352:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 381us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.548029:0:23768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 21 00010000:00010000:1.0:1782241631.548217:0:24123:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.548544:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.548567:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.548576:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.548584:0:24123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.548590:0:24123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241631.548595:0:24123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.548603:0:24123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.548616:0:24123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.548623:0:24123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1b9c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241631.549055:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:2397:x1868815120116224:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 Request processed in 5300us (5619us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241631.549064:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:0.0:1782241631.553947:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.554880:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120116608 00000100:00100000:1.0:1782241631.554892:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120116608 00000100:00100000:1.0:1782241631.554965:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 70 00000100:00100000:1.0:1782241631.554975:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+15:18872:x1868815120116608:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782241631.555063:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.555079:0:22612:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b89d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505834 expref: 15 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.555089:0:22612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.555132:0:22612:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b89d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505834 expref: 15 pid: 22612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.555155:0:22612:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b89d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505834 expref: 15 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241631.555169:0:22612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48818380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22612:1868815140140288:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241631.555241:0:22612:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e508a5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241631.558567:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.558934:0:22612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48818380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22612:1868815140140288:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241631.558971:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120116736 00000100:00100000:2.0:1782241631.558979:0:22599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120116736 00010000:00010000:2.0:1782241631.559017:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b89d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505834 expref: 16 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.559047:0:22612:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241631.559108:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:2.0:1782241631.559119:0:22599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+16:2399:x1868815120116736:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241631.559134:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241631.559143:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b89d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505834 expref: 16 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.559166:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b89d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505834 expref: 16 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.559188:0:22599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1b89d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505834 expref: 16 pid: 22612 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.559203:0:22599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241631.559209:0:22599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b930 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505865 expref: 15 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.559219:0:22599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.559227:0:22599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.559246:0:22599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.559276:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241631.559331:0:22599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+15:2399:x1868815120116736:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 213us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.559339:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 22 00010000:00010000:1.0:1782241631.559393:0:22612:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.559400:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.559616:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.559629:0:22612:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b999 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505881 expref: 15 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.559638:0:22612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.559668:0:22612:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b999 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505881 expref: 15 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.559680:0:22612:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b999 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505881 expref: 15 pid: 24571 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241631.559692:0:22612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48818380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22612:1868815140140416:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241631.559739:0:22612:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e508a50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241631.566194:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.566294:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120116864 00000100:00100000:2.0:1782241631.566303:0:22599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120116864 00010000:00010000:2.0:1782241631.566409:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b999 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505881 expref: 16 pid: 24571 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241631.566453:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:2.0:1782241631.566463:0:22599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e50598850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+16:2398:x1868815120116864:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241631.566479:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241631.566486:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b999 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505881 expref: 16 pid: 24571 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.566504:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b999 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505881 expref: 16 pid: 24571 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.566527:0:22599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890d4195e400) 00010000:00010000:2.0:1782241631.566532:0:22599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.566542:0:22599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.566562:0:22599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.566581:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241631.566636:0:22599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e50598850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+16:2398:x1868815120116864:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 173us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.566644:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00010000:00010000:3.0:1782241631.568063:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b999 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505881 expref: 15 pid: 24571 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241631.568084:0:22612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48818380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22612:1868815140140416:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241631.568108:0:22612:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.568117:0:22612:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.568122:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782241631.570113:0:22612:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:3.0:1782241631.570577:0:22612:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:3.0:1782241631.570621:0:22612:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:3.0:1782241631.570711:0:22612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22612:1868815140140544:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782241631.570847:0:22612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241631.571002:0:22612:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863480 going to sleep for 11 seconds 00000100:00100000:2.0:1782241631.571290:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140140544 00000100:00100000:2.0:1782241631.571300:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140140544 00000100:00100000:2.0:1782241631.571354:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782241631.571364:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22612:x1868815140140544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782241631.571465:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22612:x1868815140140544:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.571472:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782241631.571493:0:22612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22612:1868815140140544:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1782241631.571660:0:22612:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:3.0:1782241631.571710:0:22612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22612:1868815140140672:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782241631.571742:0:22612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241631.571796:0:22612:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241631.571924:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140140672 00000100:00100000:0.0:1782241631.571929:0:22616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140140672 00000100:00100000:0.0:1782241631.571964:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782241631.571973:0:22616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22612:x1868815140140672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782241631.572089:0:22616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22612:x1868815140140672:12345-0@lo:1000:mdt00_001.0 Request processed in 117us (346us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1782241631.572097:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782241631.575283:0:22612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22612:1868815140140672:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1782241631.575345:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575373:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575393:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575400:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c2200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241631.575405:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575413:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575430:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890d4195e400) 00010000:00010000:3.0:1782241631.575433:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241631.575439:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575445:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2200/0xc9959f2fb1e1b9d1 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575482:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575488:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575494:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575499:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c3800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241631.575508:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575515:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575524:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:3.0:1782241631.575526:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241631.575534:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b930 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505865 expref: 18 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575546:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b930 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505865 expref: 18 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575556:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b930 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505865 expref: 18 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.575618:0:22612:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b930 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505865 expref: 18 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241631.575635:0:22612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22612:1868815140140800:192.168.204.58@tcp:105: 00000100:00100000:3.0:1782241631.575723:0:22612:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e778639c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241631.580625:0:22612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22612:1868815140140800:192.168.204.58@tcp:105: 00010000:00010000:3.0:1782241631.580673:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580684:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3800/0xc9959f2fb1e1b929 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580741:0:22612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b9d8 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580791:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b9d8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580804:0:22612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b9d8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580815:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b9d8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580821:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b9d8 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580828:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b9d8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580834:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241631.580838:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b9d8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580845:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b9d8 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580856:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:3.0:1782241631.580859:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241631.580862:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b9d8 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580868:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1b9d8 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580901:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580907:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580913:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580929:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c2800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241631.580932:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580939:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580948:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:3.0:1782241631.580951:0:22612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782241631.580954:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241631.580960:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c2800/0xc9959f2fb1e1b9ca lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22612 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241631.581127:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+18:18872:x1868815120116608:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 26151us (27186us total) trans 12884901924 rc 0/0 00000100:00100000:3.0:1782241631.581138:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 70 00000020:00080000:3.0:1782241631.581155:0:22612:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1782241631.582747:0:22647:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1782241631.582790:0:22647:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782241631.582813:0:22647:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1782241631.582821:0:22647:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1782241631.583854:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241631.584167:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120116992 00000100:00100000:3.0:1782241631.584177:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120116992 00000100:00100000:2.0:1782241631.584599:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:2.0:1782241631.584611:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+18:18871:x1868815120116992:12345-192.168.204.58@tcp:49:bash.0 00000100:00100000:2.0:1782241631.584741:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+18:18871:x1868815120116992:12345-192.168.204.58@tcp:49:bash.0 Request processed in 132us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.584748:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:0.0:1782241631.585908:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.586051:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120117248 00000100:00100000:1.0:1782241631.586060:0:22615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120117248 00000100:00100000:1.0:1782241631.586108:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:1.0:1782241631.586129:0:22615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+18:18872:x1868815120117248:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782241631.586450:0:22615:0:(mdd_object.c:4010:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782241631.586489:0:22615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1782241631.586524:0:22615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9df lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.586542:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9df lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.586554:0:22615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9df lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.586564:0:22615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9df lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.586571:0:22615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9df lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.586578:0:22615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9df lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241631.586602:0:22615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782241631.586690:0:22615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+20:18872:x1868815120117248:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 561us (787us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1782241631.586699:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00000020:00080000:1.0:1782241631.586704:0:22615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782241631.587030:0:22600:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241631.587038:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9df lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.587046:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c3200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241631.587050:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9df lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.587058:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9df lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.587072:0:22600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff890d4195e400) 00010000:00010000:0.0:1782241631.587075:0:22600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782241631.587079:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9df lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.587085:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e821c3200/0xc9959f2fb1e1b9df lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.587110:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241631.587111:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241631.587113:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241631.602468:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241631.604107:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120117376 00000100:00100000:3.0:1782241631.604121:0:24125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120117376 00000100:00100000:0.0:1782241631.604442:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:0.0:1782241631.604455:0:24125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+7:18871:x1868815120117376:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:0.0:1782241631.604474:0:24125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241631.604496:0:24125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b9e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350589d expref: -99 pid: 24125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782241631.604523:0:24125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a3ad95f, atime: 0x6a3ad95d, ctime: 0x6a3ad95f, blocks: 0x0 00010000:00010000:0.0:1782241631.604545:0:24125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=694s v=(0 0) 00010000:00010000:0.0:1782241631.604550:0:24125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241631.604560:0:24125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b9e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350589d expref: 8 pid: 24125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.604598:0:24125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd0d2261/0xc9959f2fb1e1b9e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350589d expref: 8 pid: 24125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.604610:0:24125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861600, rc 0) 00000100:00100000:0.0:1782241631.604682:0:24125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+8:18871:x1868815120117376:12345-192.168.204.58@tcp:101:bash.0 Request processed in 229us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241631.604691:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:3.0:1782241631.608873:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241631.608964:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120117504 00000100:00100000:0.0:1782241631.608974:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120117504 00000100:00100000:0.0:1782241631.609177:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 71 00000100:00100000:0.0:1782241631.609188:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+20:18871:x1868815120117504:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:0.0:1782241631.609213:0:22611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241631.609244:0:22611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861200/0xc9959f2fb1e1b9ed lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335058a4 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.609281:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1b9f4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.609295:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1b9f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.609305:0:22611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1b9f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.609424:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861200/0xc9959f2fb1e1b9ed lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335058a4 expref: 22 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.609442:0:22611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1b9f4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335058a4 expref: 21 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241631.609452:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:0.0:1782241631.609455:0:22611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782241631.609459:0:22611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860800, rc 0) 00000100:00100000:0.0:1782241631.609524:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+21:18871:x1868815120117504:12345-192.168.204.58@tcp:101:bash.0 Request processed in 338us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241631.609532:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 71 00000100:00100000:3.0:1782241631.613377:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241631.613485:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120117760 00000100:00100000:1.0:1782241631.613494:0:22615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120117760 00000100:00100000:1.0:1782241631.613557:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:1.0:1782241631.613568:0:22615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+21:18871:x1868815120117760:12345-192.168.204.58@tcp:35:bash.0 00000001:00080000:1.0:1782241631.613819:0:22615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:1.0:1782241631.613919:0:22615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:1.0:1782241631.614289:0:22615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+24:18871:x1868815120117760:12345-192.168.204.58@tcp:35:bash.0 Request processed in 719us (918us total) trans 12884901929 rc 0/0 00000100:00100000:1.0:1782241631.614297:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 14 00000020:00080000:1.0:1782241631.614303:0:22615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1782241631.782957:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.783244:0:24571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120118016 00000100:00100000:2.0:1782241631.783254:0:24571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120118016 00000100:00100000:2.0:1782241631.783334:0:24571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 72 00000100:00100000:2.0:1782241631.783358:0:24571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+24:18882:x1868815120118016:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241631.783382:0:24571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241631.783402:0:24571:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1b9fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335058ab expref: -99 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241631.783503:0:24571:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782241631.783606:0:24571:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1b9fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335058ab expref: 26 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.783621:0:24571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195d300) 00010000:00010000:2.0:1782241631.783625:0:24571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241631.783631:0:24571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1b9fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335058ab expref: 26 pid: 24571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.783646:0:24571:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fadc00, rc 0) 00000100:00100000:2.0:1782241631.784124:0:24571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+25:18882:x1868815120118016:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 765us (1177us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1782241631.784132:0:24571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 72 00000100:00100000:3.0:1782241631.791854:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241631.793729:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120118144 00000100:00100000:2.0:1782241631.793744:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120118144 00000100:00100000:2.0:1782241631.793847:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 73 00000100:00100000:2.0:1782241631.793857:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+25:18882:x1868815120118144:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:2.0:1782241631.793937:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1ba09 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.793953:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1ba09 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.793983:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1ba09 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.793999:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1ba10 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794007:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1ba10 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794013:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1ba10 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794097:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1ba17 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794106:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1ba17 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794113:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1ba17 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241631.794167:0:22613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1ba17 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794180:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1ba09 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794185:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1ba09 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794192:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1ba09 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794207:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fadc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241631.794211:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1ba09 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794218:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1ba09 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794230:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff890d4195e500) 00010000:00010000:2.0:1782241631.794233:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241631.794237:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1ba09 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794242:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1ba09 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794257:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1ba10 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794262:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1ba10 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794268:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1ba10 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794273:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241631.794276:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1ba10 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794282:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1ba10 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794301:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff890e528b3800) 00010000:00010000:2.0:1782241631.794304:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241631.794307:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1ba10 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794313:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1ba10 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794327:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1ba17 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794333:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1ba17 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794340:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1ba17 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794344:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241631.794347:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1ba17 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794352:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1ba17 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794359:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241631.794362:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241631.794365:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1ba17 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241631.794370:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1ba17 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241631.794466:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+25:18882:x1868815120118144:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 609us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241631.794474:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 73 00000100:00100000:0.0:1782241631.804516:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241631.804619:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120118400 00000100:00100000:3.0:1782241631.804630:0:22614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120118400 00000100:00100000:3.0:1782241631.804693:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:3.0:1782241631.804704:0:22614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+25:18882:x1868815120118400:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:3.0:1782241631.805169:0:22614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+26:18882:x1868815120118400:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 465us (660us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1782241631.805178:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 15 00010000:00010000:2.0:1782241632.004927:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241632.005066:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140140928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241632.005152:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241632.005787:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140140928 00000100:00100000:2.0:1782241632.005795:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140140928 00000100:00100000:2.0:1782241632.005850:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782241632.005861:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140140928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241632.005890:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1782241632.005954:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140140928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241632.005961:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782241632.006148:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140140928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241633.033546:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140141056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241633.033640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241633.033805:0:23684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140141056 00000100:00100000:1.0:1782241633.033815:0:23684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140141056 00000100:00100000:1.0:1782241633.034038:0:23684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782241633.034048:0:23684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140141056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782241633.034086:0:23684:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1782241633.034147:0:23684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140141056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241633.034155:0:23684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782241633.034199:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140141056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241633.036087:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241633.036107:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140141184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241633.036176:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241633.036217:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140141184 00000100:00100000:3.0:1782241633.036223:0:22617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140141184 00000100:00100000:3.0:1782241633.036263:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782241633.036271:0:22617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140141184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782241633.036314:0:22617:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1782241633.036357:0:22617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140141184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241633.036364:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782241633.036403:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140141184:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782241633.047159:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782241633.559272:0:25700:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1782241633.698152:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241633.698202:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241633.698225:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241633.698244:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241633.698260:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241633.698281:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241633.698295:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241633.698322:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241633.698369:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241633.698403:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120119040 00000100:00100000:1.0:1782241633.698412:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120119040 00000100:00100000:1.0:1782241633.698464:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120119552 00000100:00100000:1.0:1782241633.698466:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120119552 00000100:00100000:1.0:1782241633.698477:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120118912 00000100:00100000:1.0:1782241633.698479:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120118912 00000100:00100000:3.0:1782241633.698585:0:22604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120118528 00000100:00100000:3.0:1782241633.698590:0:22604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120118528 00000100:00100000:3.0:1782241633.698624:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 167 00000100:00100000:3.0:1782241633.698633:0:22604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+13:2397:x1868815120118528:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241633.698707:0:22604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596d410-35c6-4d46-bbb3-954c5be7798e+13:2397:x1868815120118528:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 74us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241633.698716:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 167 00000100:00100000:3.0:1782241633.698749:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120118784 00000100:00100000:3.0:1782241633.698753:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120118784 00000100:00100000:3.0:1782241633.698795:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120119296 00000100:00100000:3.0:1782241633.698798:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120119296 00000100:00100000:3.0:1782241633.698811:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120118656 00000100:00100000:3.0:1782241633.698813:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120118656 00000100:00100000:3.0:1782241633.698826:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120119168 00000100:00100000:3.0:1782241633.698828:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120119168 00000100:00100000:3.0:1782241633.698850:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:3.0:1782241633.698856:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2397:x1868815120118784:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241633.698892:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2397:x1868815120118784:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 36us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241633.698899:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:3.0:1782241633.698912:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:3.0:1782241633.698918:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120119296:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241633.698941:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120119296:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 23us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241633.698947:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:3.0:1782241633.698969:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:3.0:1782241633.698976:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+26:2397:x1868815120118656:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241633.699009:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+26:2397:x1868815120118656:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 33us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241633.699015:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:3.0:1782241633.699027:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 68 00000100:00100000:3.0:1782241633.699033:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2397:x1868815120119168:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241633.699057:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+6:2397:x1868815120119168:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 24us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241633.699063:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 68 00000100:00100000:3.0:1782241633.699081:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120119424 00000100:00100000:3.0:1782241633.699084:0:24124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120119424 00000100:00100000:3.0:1782241633.699114:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:3.0:1782241633.699121:0:24124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2397:x1868815120119040:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241633.699148:0:24124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+5:2397:x1868815120119040:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 27us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241633.699155:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:3.0:1782241633.699167:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:3.0:1782241633.699173:0:24124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120119552:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241633.699194:0:24124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120119552:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 22us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241633.699199:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:3.0:1782241633.699209:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:3.0:1782241633.699214:0:24124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120119424:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241633.699247:0:24124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ba7844f-6088-459d-bcca-a5136f4f097b+5:2397:x1868815120119424:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 32us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241633.699253:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00080000:3.0:1782241633.699270:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241633.699273:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782241633.699276:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782241633.699278:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241633.699737:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:1.0:1782241633.699747:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+8:2397:x1868815120118912:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241633.699803:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+8:2397:x1868815120118912:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 59us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241633.699810:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 29 00000040:00080000:2.0:1782241633.989599:0:23364:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782241634.053241:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782241634.053267:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e770ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140141312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241634.053340:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241634.053499:0:24127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140141312 00000100:00100000:2.0:1782241634.053507:0:24127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140141312 00000100:00100000:2.0:1782241634.053598:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782241634.053608:0:24127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1868815140141312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782241634.053635:0:24127:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1782241634.053677:0:24127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1868815140141312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241634.053683:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782241634.053795:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e770ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140141312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782241634.053860:0:22600:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782241634.060604:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782241635.077863:0:23368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241635.228440:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241635.228499:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241635.228505:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120119808 00000100:00100000:0.0:1782241635.228516:0:24123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120119808 00000100:00100000:0.0:1782241635.228686:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:0.0:1782241635.228698:0:24123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+8:2399:x1868815120119808:12345-192.168.204.58@tcp:16:kworker.0 00000100:00100000:1.0:1782241635.228838:0:24128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120119680 00000100:00100000:1.0:1782241635.228844:0:24128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120119680 00002000:00100000:1.0:1782241635.228877:0:24128:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff890d477f8700 x1868815120119680/t0(0) o4->5172bd8f-a514-4eaf-8b26-905e2daf8f5c@192.168.204.58@tcp:726/0 lens 504/0 e 0 to 0 dl 1782241646 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1782241635.228888:0:24128:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d477f8700 with x1868815120119680 ext(0->8) 00002000:00010000:1.0:1782241635.228895:0:24128:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890d477f8700 00000100:00080000:2.0:1782241635.228904:0:22607:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241635.228915:0:24128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:1.0:1782241635.228926:0:24128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+9:2399:x1868815120119680:12345-192.168.204.58@tcp:4:bash.0 00000100:00100000:0.0:1782241635.228987:0:24123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+9:2399:x1868815120119808:12345-192.168.204.58@tcp:16:kworker.0 Request processed in 290us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241635.228996:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:0.0:1782241635.234753:0:24128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5172bd8f-a514-4eaf-8b26-905e2daf8f5c+10:2399:x1868815120119680:12345-192.168.204.58@tcp:4:bash.0 Request processed in 5817us (6243us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1782241635.234788:0:24128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 0 00002000:00100000:0.0:1782241635.234913:0:24128:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff890d477f8700 x1868815120119680/t12884901895(0) o4->5172bd8f-a514-4eaf-8b26-905e2daf8f5c@192.168.204.58@tcp:726/0 lens 504/448 e 0 to 0 dl 1782241646 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1782241635.234925:0:24128:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d477f8700 with x1868815120119680 ext(0->8) 00002000:00010000:0.0:1782241635.234932:0:24128:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890d477f8700 Debug log: 14532 lines, 14532 kept, 0 dropped, 0 bad.